Dec 01 13:38:57 user nova-compute[75288]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75288) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75288) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75288) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 13:38:57 user nova-compute[75288]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:38:57 user nova-compute[75288]: INFO nova.virt.driver [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 01 13:38:57 user nova-compute[75288]: INFO nova.compute.provider_config [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] Acquiring lock "singleton_lock" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] Acquired lock "singleton_lock" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] Releasing lock "singleton_lock" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] Full set of CONF: {{(pid=75288) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ******************************************************************************** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] Configuration options gathered from: {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ================================================================================ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] allow_resize_to_same_host      = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] arq_binding_timeout            = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] backdoor_port                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] backdoor_socket                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] block_device_allocate_retries  = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] block_device_allocate_retries_interval = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cert                           = self.pem {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute_monitors               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] config_dir                     = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] config_drive_format            = iso9660 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] config_source                  = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] console_host                   = user {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] control_exchange               = nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cpu_allocation_ratio           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] daemon                         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] debug                          = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] default_access_ip_network_name = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] default_availability_zone      = nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] default_ephemeral_format       = ext4 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] default_green_pool_size        = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] default_schedule_zone          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] disk_allocation_ratio          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] enable_new_services            = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] enabled_ssl_apis               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] flat_injected                  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] force_config_drive             = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] force_raw_images               = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] graceful_shutdown_timeout      = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] heal_instance_info_cache_interval = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] host                           = user {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] instance_build_timeout         = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] instance_delete_interval       = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] instance_name_template         = instance-%08x {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] instance_usage_audit           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] instance_usage_audit_period    = month {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] internal_service_availability_zone = internal {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] key                            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] live_migration_retry_count     = 30 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] log_config_append              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] log_dir                        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] log_file                       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] log_options                    = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] log_rotate_interval            = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] log_rotate_interval_type       = days {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] log_rotation_type              = none {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] long_rpc_timeout               = 1800 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] max_concurrent_builds          = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] max_concurrent_live_migrations = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] max_concurrent_snapshots       = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] max_local_block_devices        = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] max_logfile_count              = 30 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] max_logfile_size_mb            = 200 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] maximum_instance_delete_attempts = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] metadata_listen                = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] metadata_listen_port           = 8775 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] metadata_workers               = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] migrate_max_retries            = -1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] mkisofs_cmd                    = genisoimage {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] my_ip                          = 10.0.0.210 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] network_allocate_retries       = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] osapi_compute_listen_port      = 8774 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] osapi_compute_unique_server_name_scope =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] osapi_compute_workers          = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] password_length                = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] periodic_enable                = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] periodic_fuzzy_delay           = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] pointer_model                  = ps2mouse {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] preallocate_images             = none {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] publish_errors                 = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] pybasedir                      = /opt/stack/nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ram_allocation_ratio           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] rate_limit_burst               = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] rate_limit_except_level        = CRITICAL {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] rate_limit_interval            = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] reboot_timeout                 = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] reclaim_instance_interval      = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] record                         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] reimage_timeout_per_gb         = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] report_interval                = 120 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] rescue_timeout                 = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] reserved_host_cpus             = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] reserved_host_disk_mb          = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] reserved_host_memory_mb        = 512 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] reserved_huge_pages            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] resize_confirm_window          = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] resize_fs_using_block_device   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] resume_guests_state_on_host_boot = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] rpc_response_timeout           = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] run_external_periodic_tasks    = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] running_deleted_instance_action = reap {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] running_deleted_instance_timeout = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler_instance_sync_interval = 120 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_down_time              = 720 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] servicegroup_driver            = db {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] shelved_offload_time           = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] shelved_poll_interval          = 3600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] shutdown_timeout               = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] source_is_ipv6                 = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ssl_only                       = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] state_path                     = /opt/stack/data/nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] sync_power_state_interval      = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] sync_power_state_pool_size     = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] syslog_log_facility            = LOG_USER {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] tempdir                        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] timeout_nbd                    = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] transport_url                  = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] update_resources_interval      = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] use_cow_images                 = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] use_eventlog                   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] use_journal                    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] use_json                       = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] use_rootwrap_daemon            = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] use_stderr                     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] use_syslog                     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vcpu_pin_set                   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plugging_is_fatal          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plugging_timeout           = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] virt_mkfs                      = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] volume_usage_poll_interval     = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] watch_log_file                 = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] web                            = /usr/share/spice-html5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_concurrency.disable_process_locking = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.auth_strategy              = keystone {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.compute_link_prefix        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.dhcp_domain                = novalocal {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.enable_instance_password   = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.glance_link_prefix         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.instance_list_per_project_cells = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.list_records_by_skipping_down_cells = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.local_metadata_per_cell    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.max_limit                  = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.metadata_cache_expiration  = 15 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.neutron_default_tenant_id  = default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.use_forwarded_for          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.use_neutron_default_nets   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.vendordata_dynamic_targets = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.vendordata_jsonfile_path   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.backend_argument         = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.config_prefix            = cache.oslo {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.dead_timeout             = 60.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.debug_cache_backend      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.enable_retry_client      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.enable_socket_keepalive  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.enabled                  = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.expiration_time          = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.hashclient_retry_attempts = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_dead_retry      = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_password        =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_sasl_enabled    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.memcache_username        =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.proxies                  = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.retry_attempts           = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.retry_delay              = 0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.socket_keepalive_count   = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.socket_keepalive_idle    = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.socket_keepalive_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.tls_allowed_ciphers      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.tls_cafile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.tls_certfile             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.tls_enabled              = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cache.tls_keyfile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.auth_section            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.auth_type               = password {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.cafile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.certfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.collect_timing          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.cross_az_attach         = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.debug                   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.endpoint_template       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.http_retries            = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.keyfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.os_region_name          = RegionOne {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.split_loggers           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cinder.timeout                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.cpu_dedicated_set      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.cpu_shared_set         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.image_type_exclude_list = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.resource_provider_association_refresh = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.shutdown_retry_interval = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] conductor.workers              = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] console.allowed_origins        = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] console.ssl_ciphers            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] console.ssl_minimum_version    = default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] consoleauth.token_ttl          = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.cafile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.certfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.collect_timing          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.connect_retries         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.connect_retry_delay     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.endpoint_override       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.keyfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.max_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.min_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.region_name             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.service_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.service_type            = accelerator {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.split_loggers           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.status_code_retries     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.timeout                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] cyborg.version                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.backend               = sqlalchemy {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.connection            = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.connection_debug      = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.connection_parameters =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.connection_recycle_time = 3600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.connection_trace      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.db_inc_retry_interval = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.db_max_retries        = 20 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.db_max_retry_interval = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.db_retry_interval     = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.max_overflow          = 50 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.max_pool_size         = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.max_retries           = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.mysql_wsrep_sync_wait = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.pool_timeout          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.retry_interval        = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.slave_connection      = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] database.sqlite_synchronous    = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.backend           = sqlalchemy {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.connection        = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.connection_debug  = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.connection_parameters =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.connection_recycle_time = 3600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.connection_trace  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.db_inc_retry_interval = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.db_max_retries    = 20 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.db_max_retry_interval = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.db_retry_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.max_overflow      = 50 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.max_pool_size     = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.max_retries       = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.pool_timeout      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.retry_interval    = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.slave_connection  = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] api_database.sqlite_synchronous = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] devices.enabled_mdev_types     = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ephemeral_storage_encryption.enabled = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.api_servers             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.cafile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.certfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.collect_timing          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.connect_retries         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.connect_retry_delay     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.debug                   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.default_trusted_certificate_ids = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.enable_certificate_validation = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.enable_rbd_download     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.endpoint_override       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.keyfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.max_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.min_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.num_retries             = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.rbd_ceph_conf           =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.rbd_connect_timeout     = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.rbd_pool                =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.rbd_user                =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.region_name             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.service_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.service_type            = image {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.split_loggers           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.status_code_retries     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.timeout                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.verify_glance_signatures = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] glance.version                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] guestfs.debug                  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.config_drive_cdrom      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.config_drive_inject_password = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.enable_remotefx         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.instances_path_share    =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.limit_cpu_features      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.use_multipath_io        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.vswitch_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] mks.enabled                    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] image_cache.manager_interval   = 2400 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] image_cache.precache_concurrency = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] image_cache.remove_unused_base_images = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] image_cache.subdirectory_name  = _base {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.api_max_retries         = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.api_retry_interval      = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.auth_section            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.auth_type               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.cafile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.certfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.collect_timing          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.conductor_group         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.connect_retries         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.connect_retry_delay     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.endpoint_override       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.keyfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.max_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.min_version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.peer_list               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.region_name             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.serial_console_state_timeout = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.service_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.service_type            = baremetal {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.split_loggers           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.status_code_retries     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.timeout                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ironic.version                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] key_manager.fixed_key          = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.barbican_api_version  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.barbican_endpoint     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.barbican_endpoint_type = public {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.barbican_region_name  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.cafile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.certfile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.collect_timing        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.insecure              = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.keyfile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.number_of_retries     = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.retry_delay           = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.send_service_user_token = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.split_loggers         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.timeout               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.verify_ssl            = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican.verify_ssl_path       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.auth_section = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.auth_type = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.cafile   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.certfile = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.collect_timing = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.insecure = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.keyfile  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.split_loggers = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] barbican_service_user.timeout  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.approle_role_id          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.approle_secret_id        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.cafile                   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.certfile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.collect_timing           = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.insecure                 = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.keyfile                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.kv_mountpoint            = secret {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.kv_path                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.kv_version               = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.namespace                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.root_token_id            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.split_loggers            = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.ssl_ca_crt_file          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.timeout                  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.use_ssl                  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.auth_section          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.auth_type             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.cafile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.certfile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.collect_timing        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.connect_retries       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.connect_retry_delay   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.endpoint_override     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.insecure              = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.keyfile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.max_version           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.min_version           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.region_name           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.service_name          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.service_type          = identity {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.split_loggers         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.status_code_retries   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.timeout               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] keystone.version               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.connection_uri         =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.cpu_mode               = custom {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: WARNING oslo_config.cfg [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.cpu_power_governor_high = performance {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.cpu_power_management   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.device_detach_attempts = 8 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.device_detach_timeout  = 20 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.disk_cachemodes        = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.disk_prefix            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.enabled_perf_events    = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.file_backed_memory     = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.gid_maps               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.hw_disk_discard        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.hw_machine_type        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.images_rbd_pool        = rbd {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.images_type            = default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.images_volume_group    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.inject_key             = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.inject_partition       = -2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.inject_password        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.iscsi_iface            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.iser_use_multipath     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_downtime = 500 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_inbound_addr = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_scheme  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_timeout_action = abort {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_tunnelled = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: WARNING oslo_config.cfg [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 01 13:38:57 user nova-compute[75288]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 01 13:38:57 user nova-compute[75288]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 01 13:38:57 user nova-compute[75288]: and ``live_migration_inbound_addr`` respectively.
Dec 01 13:38:57 user nova-compute[75288]: ).  Its value may be silently ignored in the future.
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.live_migration_with_native_tls = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.max_queues             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.nfs_mount_options      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.num_pcie_ports         = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.pmem_namespaces        = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.quobyte_client_cfg     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rbd_secret_uuid        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rbd_user               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rescue_image_id        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rescue_kernel_id       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.rx_queue_size          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.smbfs_mount_options    =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.snapshot_compression   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.snapshot_image_format  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.sparse_logical_volumes = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.swtpm_enabled          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.swtpm_group            = tss {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.swtpm_user             = tss {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.sysinfo_serial         = unique {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.tb_cache_size          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.tx_queue_size          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.uid_maps               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.use_virtio_for_bridges = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.virt_type              = kvm {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.volume_clear           = zero {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.volume_clear_size      = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.volume_use_multipath   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.vzstorage_cache_path   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.auth_section           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.auth_type              = password {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.cafile                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.certfile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.collect_timing         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.connect_retries        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.connect_retry_delay    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.default_floating_pool  = public {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.endpoint_override      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.extension_sync_interval = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.http_retries           = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.insecure               = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.keyfile                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.max_version            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.min_version            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.ovs_bridge             = br-int {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.physnets               = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.region_name            = RegionOne {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.service_metadata_proxy = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.service_name           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.service_type           = network {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.split_loggers          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.status_code_retries    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.timeout                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] neutron.version                = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] notifications.bdms_in_notifications = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] notifications.default_level    = INFO {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] notifications.notification_format = unversioned {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] notifications.notify_on_state_change = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] pci.alias                      = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] pci.device_spec                = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] pci.report_in_placement        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.auth_section         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.auth_type            = password {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.cafile               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.certfile             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.collect_timing       = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.connect_retries      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.connect_retry_delay  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.default_domain_id    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.default_domain_name  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.domain_id            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.domain_name          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.endpoint_override    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.insecure             = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.keyfile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.max_version          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.min_version          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.password             = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.project_domain_id    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.project_domain_name  = Default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.project_id           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.project_name         = service {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.region_name          = RegionOne {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.service_name         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.service_type         = placement {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.split_loggers        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.status_code_retries  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.system_scope         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.timeout              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.trust_id             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.user_domain_id       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.user_domain_name     = Default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.user_id              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.username             = placement {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] placement.version              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.cores                    = 20 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.count_usage_from_placement = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.injected_file_content_bytes = 10240 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.injected_file_path_length = 255 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.injected_files           = 5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.instances                = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.key_pairs                = 100 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.metadata_items           = 128 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.ram                      = 51200 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.recheck_quota            = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.server_group_members     = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] quota.server_groups            = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] rdp.enabled                    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.image_metadata_prefilter = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.max_attempts         = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.max_placement_results = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] scheduler.workers              = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.host_subset_size = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.isolated_hosts = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.isolated_images = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.pci_in_placement = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.track_instance_changes = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] metrics.required               = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] metrics.weight_multiplier      = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] metrics.weight_setting         = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] serial_console.enabled         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] serial_console.port_range      = 10000:20000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] serial_console.serialproxy_port = 6083 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.auth_section      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.auth_type         = password {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.cafile            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.certfile          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.collect_timing    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.insecure          = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.keyfile           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.send_service_user_token = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.split_loggers     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] service_user.timeout           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.agent_enabled            = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.enabled                  = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.html5proxy_port          = 6082 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.image_compression        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.jpeg_compression         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.playback_compression     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.server_listen            = 127.0.0.1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.streaming_mode           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] spice.zlib_compression         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] upgrade_levels.baseapi         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] upgrade_levels.compute         = auto {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] upgrade_levels.conductor       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] upgrade_levels.scheduler       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.cafile = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.certfile = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.insecure = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vendordata_dynamic_auth.timeout = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.api_retry_count         = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.ca_file                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.cache_prefix            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.cluster_name            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.connection_pool_size    = 10 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.console_delay_seconds   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.datastore_regex         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.host_ip                 = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.host_password           = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.host_port               = 443 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.host_username           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.insecure                = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.integration_bridge      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.maximum_objects         = 100 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.pbm_default_policy      = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.pbm_enabled             = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.pbm_wsdl_location       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.serial_port_proxy_uri   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.serial_port_service_uri = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.task_poll_interval      = 0.5 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.use_linked_clone        = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.vnc_keymap              = en-us {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.vnc_port                = 5900 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vmware.vnc_port_total          = 10000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.auth_schemes               = ['none'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.enabled                    = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.novncproxy_port            = 6080 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.vencrypt_ca_certs          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.vencrypt_client_cert       = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vnc.vencrypt_client_key        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.disable_rootwrap   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.enable_numa_live_migration = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.libvirt_disable_apic = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.client_socket_timeout     = 900 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.default_pool_size         = 1000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.keep_alive                = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.max_header_line           = 16384 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.ssl_ca_file               = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.ssl_cert_file             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.ssl_key_file              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.tcp_keepidle              = 600 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] zvm.ca_file                    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] zvm.cloud_connector_url        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] zvm.reachable_timeout          = 300 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.enforce_new_defaults = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.enforce_scope      = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.policy_default_rule = default {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.connection_string     = messaging:// {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.enabled               = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.es_doc_type           = notification {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.es_scroll_size        = 10000 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.es_scroll_time        = 2m {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.filter_error_trace    = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.hmac_keys             = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.sentinel_service_name = mymaster {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.socket_timeout        = 0.1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.trace_requests        = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler.trace_sqlalchemy      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler_jaeger.process_tags   = {} {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler_jaeger.service_name_prefix = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] profiler_otlp.service_name_prefix = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] remote_debug.host              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] remote_debug.port              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_notifications.retry = -1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.auth_section        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.auth_type           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.cafile              = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.certfile            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.collect_timing      = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.connect_retries     = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.connect_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.endpoint_id         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.endpoint_override   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.insecure            = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.keyfile             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.max_version         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.min_version         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.region_name         = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.service_name        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.service_type        = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.split_loggers       = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.status_code_retries = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.status_code_retry_delay = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.timeout             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.valid_interfaces    = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_limit.version             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_reports.file_event_handler = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] oslo_reports.log_dir           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_ovs_privileged.group  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] vif_plug_ovs_privileged.user   = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_ovs.isolate_vif         = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] os_brick.lock_path             = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] privsep_osbrick.capabilities   = [21] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] privsep_osbrick.group          = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] privsep_osbrick.helper_command = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] privsep_osbrick.user           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] nova_sys_admin.group           = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] nova_sys_admin.helper_command  = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] nova_sys_admin.user            = None {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG oslo_service.service [None req-e3d6869e-8af7-4694-a0a7-820ac798cb17 None None] ******************************************************************************** {{(pid=75288) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 01 13:38:57 user nova-compute[75288]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 01 13:38:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Connecting to libvirt: qemu:///system {{(pid=75288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fdbe03ee680> {{(pid=75288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 01 13:38:57 user nova-compute[75288]: libvirt:  error : internal error: could not initialize domain event timer
Dec 01 13:38:57 user nova-compute[75288]: WARNING nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 01 13:38:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fdbe03ee680> {{(pid=75288) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Starting native event thread {{(pid=75288) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Starting green dispatch thread {{(pid=75288) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 01 13:38:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Starting connection event dispatch thread {{(pid=75288) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 01 13:38:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Connection event '1' reason 'None'
Dec 01 13:38:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 01 13:38:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.mount [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Initialising _HostMountState generation 0 {{(pid=75288) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 01 13:39:05 user nova-compute[75288]: INFO nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host capabilities <capabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <host>
Dec 01 13:39:05 user nova-compute[75288]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 01 13:39:05 user nova-compute[75288]:     <cpu>
Dec 01 13:39:05 user nova-compute[75288]:       <arch>x86_64</arch>
Dec 01 13:39:05 user nova-compute[75288]:       <model>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <microcode version='1070'/>
Dec 01 13:39:05 user nova-compute[75288]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 01 13:39:05 user nova-compute[75288]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='osxsave'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='invtsc'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='rsba'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature name='skip-l1dfl-vmentry'/>
Dec 01 13:39:05 user nova-compute[75288]:       <pages unit='KiB' size='4'/>
Dec 01 13:39:05 user nova-compute[75288]:       <pages unit='KiB' size='2048'/>
Dec 01 13:39:05 user nova-compute[75288]:     </cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <power_management>
Dec 01 13:39:05 user nova-compute[75288]:       <suspend_mem/>
Dec 01 13:39:05 user nova-compute[75288]:       <suspend_disk/>
Dec 01 13:39:05 user nova-compute[75288]:       <suspend_hybrid/>
Dec 01 13:39:05 user nova-compute[75288]:     </power_management>
Dec 01 13:39:05 user nova-compute[75288]:     <iommu support='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <migration_features>
Dec 01 13:39:05 user nova-compute[75288]:       <live/>
Dec 01 13:39:05 user nova-compute[75288]:       <uri_transports>
Dec 01 13:39:05 user nova-compute[75288]:         <uri_transport>tcp</uri_transport>
Dec 01 13:39:05 user nova-compute[75288]:         <uri_transport>rdma</uri_transport>
Dec 01 13:39:05 user nova-compute[75288]:       </uri_transports>
Dec 01 13:39:05 user nova-compute[75288]:     </migration_features>
Dec 01 13:39:05 user nova-compute[75288]:     <topology>
Dec 01 13:39:05 user nova-compute[75288]:       <cells num='2'>
Dec 01 13:39:05 user nova-compute[75288]:         <cell id='0'>
Dec 01 13:39:05 user nova-compute[75288]:           <memory unit='KiB'>8189224</memory>
Dec 01 13:39:05 user nova-compute[75288]:           <pages unit='KiB' size='4'>2047306</pages>
Dec 01 13:39:05 user nova-compute[75288]:           <pages unit='KiB' size='2048'>0</pages>
Dec 01 13:39:05 user nova-compute[75288]:           <distances>
Dec 01 13:39:05 user nova-compute[75288]:             <sibling id='0' value='10'/>
Dec 01 13:39:05 user nova-compute[75288]:             <sibling id='1' value='20'/>
Dec 01 13:39:05 user nova-compute[75288]:           </distances>
Dec 01 13:39:05 user nova-compute[75288]:           <cpus num='6'>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 01 13:39:05 user nova-compute[75288]:           </cpus>
Dec 01 13:39:05 user nova-compute[75288]:         </cell>
Dec 01 13:39:05 user nova-compute[75288]:         <cell id='1'>
Dec 01 13:39:05 user nova-compute[75288]:           <memory unit='KiB'>8206460</memory>
Dec 01 13:39:05 user nova-compute[75288]:           <pages unit='KiB' size='4'>2051615</pages>
Dec 01 13:39:05 user nova-compute[75288]:           <pages unit='KiB' size='2048'>0</pages>
Dec 01 13:39:05 user nova-compute[75288]:           <distances>
Dec 01 13:39:05 user nova-compute[75288]:             <sibling id='0' value='20'/>
Dec 01 13:39:05 user nova-compute[75288]:             <sibling id='1' value='10'/>
Dec 01 13:39:05 user nova-compute[75288]:           </distances>
Dec 01 13:39:05 user nova-compute[75288]:           <cpus num='6'>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 01 13:39:05 user nova-compute[75288]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 01 13:39:05 user nova-compute[75288]:           </cpus>
Dec 01 13:39:05 user nova-compute[75288]:         </cell>
Dec 01 13:39:05 user nova-compute[75288]:       </cells>
Dec 01 13:39:05 user nova-compute[75288]:     </topology>
Dec 01 13:39:05 user nova-compute[75288]:     <cache>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 01 13:39:05 user nova-compute[75288]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 01 13:39:05 user nova-compute[75288]:     </cache>
Dec 01 13:39:05 user nova-compute[75288]:     <secmodel>
Dec 01 13:39:05 user nova-compute[75288]:       <model>apparmor</model>
Dec 01 13:39:05 user nova-compute[75288]:       <doi>0</doi>
Dec 01 13:39:05 user nova-compute[75288]:     </secmodel>
Dec 01 13:39:05 user nova-compute[75288]:     <secmodel>
Dec 01 13:39:05 user nova-compute[75288]:       <model>dac</model>
Dec 01 13:39:05 user nova-compute[75288]:       <doi>0</doi>
Dec 01 13:39:05 user nova-compute[75288]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 01 13:39:05 user nova-compute[75288]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 01 13:39:05 user nova-compute[75288]:     </secmodel>
Dec 01 13:39:05 user nova-compute[75288]:   </host>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='alpha'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>clipper</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='armv6l'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>spitz</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>nuri</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>kzm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sx1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>z2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>tosa</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>n810</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>n800</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>terrier</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>midway</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>microbit</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>verdex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>highbank</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>akita</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>connex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>collie</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='armv7l'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>spitz</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>nuri</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>kzm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sx1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>z2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>tosa</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>n810</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>n800</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>terrier</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>midway</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>microbit</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>verdex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>highbank</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>akita</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>connex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>collie</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='aarch64'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>spitz</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>nuri</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>kzm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sx1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>z2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>tosa</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>n810</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>n800</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>terrier</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>midway</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>microbit</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>verdex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>raspi3b</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>highbank</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>akita</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>connex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>collie</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <acpi default='on' toggle='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='cris'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='i686'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>x-remote</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>isapc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>microvm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='kvm'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <pae/>
Dec 01 13:39:05 user nova-compute[75288]:       <nonpae/>
Dec 01 13:39:05 user nova-compute[75288]:       <acpi default='on' toggle='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:       <apic default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='m68k'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>an5206</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>q800</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>next-cube</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='microblaze'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='microblazeel'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='mips'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='16'>malta</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='mipsel'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='16'>malta</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='mips64'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='16'>malta</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>pica61</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>magnum</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='mips64el'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='16'>malta</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>pica61</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>magnum</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='16'>boston</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='ppc'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mac99</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>40p</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>taihu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='ppc64'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2048'>powernv9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>taihu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2048'>powernv10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>40p</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mac99</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2048'>powernv8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='ppc64le'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2048'>powernv9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>taihu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2048'>powernv10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>40p</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>mac99</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2048'>powernv8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='riscv32'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='8'>spike</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>opentitan</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='5'>sifive_u</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sifive_e</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='8'>virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='riscv64'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='8'>spike</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='5'>sifive_u</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>shakti_c</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sifive_e</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='8'>virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='s390x'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='sh4'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>shix</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>r2d</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='sh4eb'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>shix</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>r2d</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='sparc'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>SS-5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>SS-20</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>LX</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>SS-4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>SS-10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>Voyager</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='sparc64'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sun4u</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>niagara</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>sun4v</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='x86_64'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>64</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>x-remote</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='1'>isapc</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>microvm</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='kvm'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <acpi default='on' toggle='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:       <apic default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='xtensa'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>sim</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>kc705</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>ml605</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>lx200</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>lx60</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]:   <guest>
Dec 01 13:39:05 user nova-compute[75288]:     <os_type>hvm</os_type>
Dec 01 13:39:05 user nova-compute[75288]:     <arch name='xtensaeb'>
Dec 01 13:39:05 user nova-compute[75288]:       <wordsize>32</wordsize>
Dec 01 13:39:05 user nova-compute[75288]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='4'>sim</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>kc705</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>ml605</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>virt</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>lx200</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>lx60</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 01 13:39:05 user nova-compute[75288]:       <domain type='qemu'/>
Dec 01 13:39:05 user nova-compute[75288]:     </arch>
Dec 01 13:39:05 user nova-compute[75288]:     <features>
Dec 01 13:39:05 user nova-compute[75288]:       <cpuselection/>
Dec 01 13:39:05 user nova-compute[75288]:       <deviceboot/>
Dec 01 13:39:05 user nova-compute[75288]:       <disksnapshot default='on' toggle='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     </features>
Dec 01 13:39:05 user nova-compute[75288]:   </guest>
Dec 01 13:39:05 user nova-compute[75288]: </capabilities>
Dec 01 13:39:05 user nova-compute[75288]: 
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 01 13:39:05 user nova-compute[75288]: <domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 13:39:05 user nova-compute[75288]:   <domain>kvm</domain>
Dec 01 13:39:05 user nova-compute[75288]:   <machine>pc-q35-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:   <arch>i686</arch>
Dec 01 13:39:05 user nova-compute[75288]:   <vcpu max='288'/>
Dec 01 13:39:05 user nova-compute[75288]:   <iothreads supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:   <os supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='firmware'/>
Dec 01 13:39:05 user nova-compute[75288]:     <loader supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>rom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pflash</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='readonly'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='secure'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </loader>
Dec 01 13:39:05 user nova-compute[75288]:   </os>
Dec 01 13:39:05 user nova-compute[75288]:   <cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='maximumMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='lm'/>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>phenom</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>n270</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>kvm64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>core2duo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>athlon</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Westmere</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Penryn</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G1</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Conroe</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>486</model>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:   </cpu>
Dec 01 13:39:05 user nova-compute[75288]:   <memoryBacking supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='sourceType'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>file</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>anonymous</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>memfd</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:   </memoryBacking>
Dec 01 13:39:05 user nova-compute[75288]:   <devices>
Dec 01 13:39:05 user nova-compute[75288]:     <disk supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='diskDevice'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>disk</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cdrom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>floppy</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>lun</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='bus'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>fdc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sata</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </disk>
Dec 01 13:39:05 user nova-compute[75288]:     <graphics supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sdl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vnc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>spice</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egl-headless</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </graphics>
Dec 01 13:39:05 user nova-compute[75288]:     <video supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='modelType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cirrus</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vmvga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>qxl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>none</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>bochs</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ramfb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </video>
Dec 01 13:39:05 user nova-compute[75288]:     <hostdev supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='mode'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>subsystem</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='startupPolicy'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>default</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>mandatory</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>requisite</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>optional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='subsysType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pci</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='capsType'/>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='pciBackend'/>
Dec 01 13:39:05 user nova-compute[75288]:     </hostdev>
Dec 01 13:39:05 user nova-compute[75288]:     <rng supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>random</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egd</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>builtin</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </rng>
Dec 01 13:39:05 user nova-compute[75288]:     <filesystem supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='driverType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>path</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>handle</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtiofs</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </filesystem>
Dec 01 13:39:05 user nova-compute[75288]:     <tpm supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-tis</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-crb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>passthrough</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>emulator</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </tpm>
Dec 01 13:39:05 user nova-compute[75288]:   </devices>
Dec 01 13:39:05 user nova-compute[75288]:   <features>
Dec 01 13:39:05 user nova-compute[75288]:     <gic supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <genid supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backup supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <sev supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:   </features>
Dec 01 13:39:05 user nova-compute[75288]: </domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 01 13:39:05 user nova-compute[75288]: <domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 13:39:05 user nova-compute[75288]:   <domain>kvm</domain>
Dec 01 13:39:05 user nova-compute[75288]:   <machine>pc-i440fx-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:   <arch>i686</arch>
Dec 01 13:39:05 user nova-compute[75288]:   <vcpu max='255'/>
Dec 01 13:39:05 user nova-compute[75288]:   <iothreads supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:   <os supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='firmware'/>
Dec 01 13:39:05 user nova-compute[75288]:     <loader supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>rom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pflash</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='readonly'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='secure'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </loader>
Dec 01 13:39:05 user nova-compute[75288]:   </os>
Dec 01 13:39:05 user nova-compute[75288]:   <cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='maximumMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='lm'/>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>phenom</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>n270</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>kvm64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>core2duo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>athlon</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Westmere</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Penryn</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G1</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Conroe</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>486</model>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:   </cpu>
Dec 01 13:39:05 user nova-compute[75288]:   <memoryBacking supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='sourceType'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>file</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>anonymous</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>memfd</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:   </memoryBacking>
Dec 01 13:39:05 user nova-compute[75288]:   <devices>
Dec 01 13:39:05 user nova-compute[75288]:     <disk supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='diskDevice'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>disk</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cdrom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>floppy</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>lun</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='bus'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ide</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>fdc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sata</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </disk>
Dec 01 13:39:05 user nova-compute[75288]:     <graphics supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sdl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vnc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>spice</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egl-headless</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </graphics>
Dec 01 13:39:05 user nova-compute[75288]:     <video supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='modelType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cirrus</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vmvga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>qxl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>none</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>bochs</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ramfb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </video>
Dec 01 13:39:05 user nova-compute[75288]:     <hostdev supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='mode'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>subsystem</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='startupPolicy'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>default</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>mandatory</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>requisite</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>optional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='subsysType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pci</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='capsType'/>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='pciBackend'/>
Dec 01 13:39:05 user nova-compute[75288]:     </hostdev>
Dec 01 13:39:05 user nova-compute[75288]:     <rng supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>random</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egd</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>builtin</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </rng>
Dec 01 13:39:05 user nova-compute[75288]:     <filesystem supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='driverType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>path</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>handle</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtiofs</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </filesystem>
Dec 01 13:39:05 user nova-compute[75288]:     <tpm supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-tis</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-crb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>passthrough</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>emulator</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </tpm>
Dec 01 13:39:05 user nova-compute[75288]:   </devices>
Dec 01 13:39:05 user nova-compute[75288]:   <features>
Dec 01 13:39:05 user nova-compute[75288]:     <gic supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <genid supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backup supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <sev supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:   </features>
Dec 01 13:39:05 user nova-compute[75288]: </domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 01 13:39:05 user nova-compute[75288]: <domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 13:39:05 user nova-compute[75288]:   <domain>kvm</domain>
Dec 01 13:39:05 user nova-compute[75288]:   <machine>pc-i440fx-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:   <arch>i686</arch>
Dec 01 13:39:05 user nova-compute[75288]:   <vcpu max='255'/>
Dec 01 13:39:05 user nova-compute[75288]:   <iothreads supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:   <os supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='firmware'/>
Dec 01 13:39:05 user nova-compute[75288]:     <loader supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>rom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pflash</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='readonly'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='secure'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </loader>
Dec 01 13:39:05 user nova-compute[75288]:   </os>
Dec 01 13:39:05 user nova-compute[75288]:   <cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='maximumMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='lm'/>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>phenom</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>n270</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>kvm64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>core2duo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>athlon</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Westmere</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Penryn</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G1</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Conroe</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>486</model>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:   </cpu>
Dec 01 13:39:05 user nova-compute[75288]:   <memoryBacking supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='sourceType'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>file</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>anonymous</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>memfd</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:   </memoryBacking>
Dec 01 13:39:05 user nova-compute[75288]:   <devices>
Dec 01 13:39:05 user nova-compute[75288]:     <disk supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='diskDevice'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>disk</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cdrom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>floppy</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>lun</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='bus'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ide</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>fdc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sata</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </disk>
Dec 01 13:39:05 user nova-compute[75288]:     <graphics supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sdl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vnc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>spice</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egl-headless</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </graphics>
Dec 01 13:39:05 user nova-compute[75288]:     <video supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='modelType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cirrus</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vmvga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>qxl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>none</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>bochs</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ramfb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </video>
Dec 01 13:39:05 user nova-compute[75288]:     <hostdev supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='mode'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>subsystem</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='startupPolicy'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>default</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>mandatory</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>requisite</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>optional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='subsysType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pci</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='capsType'/>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='pciBackend'/>
Dec 01 13:39:05 user nova-compute[75288]:     </hostdev>
Dec 01 13:39:05 user nova-compute[75288]:     <rng supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>random</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egd</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>builtin</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </rng>
Dec 01 13:39:05 user nova-compute[75288]:     <filesystem supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='driverType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>path</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>handle</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtiofs</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </filesystem>
Dec 01 13:39:05 user nova-compute[75288]:     <tpm supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-tis</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-crb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>passthrough</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>emulator</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </tpm>
Dec 01 13:39:05 user nova-compute[75288]:   </devices>
Dec 01 13:39:05 user nova-compute[75288]:   <features>
Dec 01 13:39:05 user nova-compute[75288]:     <gic supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <genid supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backup supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <sev supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:   </features>
Dec 01 13:39:05 user nova-compute[75288]: </domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 01 13:39:05 user nova-compute[75288]: <domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 13:39:05 user nova-compute[75288]:   <domain>kvm</domain>
Dec 01 13:39:05 user nova-compute[75288]:   <machine>pc-q35-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:   <arch>i686</arch>
Dec 01 13:39:05 user nova-compute[75288]:   <vcpu max='288'/>
Dec 01 13:39:05 user nova-compute[75288]:   <iothreads supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:   <os supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='firmware'/>
Dec 01 13:39:05 user nova-compute[75288]:     <loader supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>rom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pflash</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='readonly'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='secure'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </loader>
Dec 01 13:39:05 user nova-compute[75288]:   </os>
Dec 01 13:39:05 user nova-compute[75288]:   <cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='maximumMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='lm'/>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>phenom</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>n270</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>kvm64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>core2duo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>athlon</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Westmere</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Penryn</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G1</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Conroe</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>486</model>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:   </cpu>
Dec 01 13:39:05 user nova-compute[75288]:   <memoryBacking supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='sourceType'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>file</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>anonymous</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>memfd</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:   </memoryBacking>
Dec 01 13:39:05 user nova-compute[75288]:   <devices>
Dec 01 13:39:05 user nova-compute[75288]:     <disk supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='diskDevice'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>disk</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cdrom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>floppy</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>lun</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='bus'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>fdc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sata</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </disk>
Dec 01 13:39:05 user nova-compute[75288]:     <graphics supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sdl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vnc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>spice</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egl-headless</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </graphics>
Dec 01 13:39:05 user nova-compute[75288]:     <video supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='modelType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cirrus</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vmvga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>qxl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>none</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>bochs</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ramfb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </video>
Dec 01 13:39:05 user nova-compute[75288]:     <hostdev supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='mode'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>subsystem</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='startupPolicy'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>default</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>mandatory</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>requisite</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>optional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='subsysType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pci</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='capsType'/>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='pciBackend'/>
Dec 01 13:39:05 user nova-compute[75288]:     </hostdev>
Dec 01 13:39:05 user nova-compute[75288]:     <rng supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>random</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egd</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>builtin</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </rng>
Dec 01 13:39:05 user nova-compute[75288]:     <filesystem supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='driverType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>path</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>handle</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtiofs</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </filesystem>
Dec 01 13:39:05 user nova-compute[75288]:     <tpm supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-tis</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-crb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>passthrough</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>emulator</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </tpm>
Dec 01 13:39:05 user nova-compute[75288]:   </devices>
Dec 01 13:39:05 user nova-compute[75288]:   <features>
Dec 01 13:39:05 user nova-compute[75288]:     <gic supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <genid supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backup supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <sev supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:   </features>
Dec 01 13:39:05 user nova-compute[75288]: </domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 01 13:39:05 user nova-compute[75288]: <domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 13:39:05 user nova-compute[75288]:   <domain>kvm</domain>
Dec 01 13:39:05 user nova-compute[75288]:   <machine>pc-q35-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:   <arch>x86_64</arch>
Dec 01 13:39:05 user nova-compute[75288]:   <vcpu max='288'/>
Dec 01 13:39:05 user nova-compute[75288]:   <iothreads supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:   <os supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='firmware'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>efi</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:     <loader supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>rom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pflash</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='readonly'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='secure'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </loader>
Dec 01 13:39:05 user nova-compute[75288]:   </os>
Dec 01 13:39:05 user nova-compute[75288]:   <cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='maximumMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='invtsc'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='rsba'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>phenom</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>n270</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>core2duo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>athlon</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Westmere</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Penryn</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Opteron_G1</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Conroe</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>486</model>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:   </cpu>
Dec 01 13:39:05 user nova-compute[75288]:   <memoryBacking supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='sourceType'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>file</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>anonymous</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>memfd</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:   </memoryBacking>
Dec 01 13:39:05 user nova-compute[75288]:   <devices>
Dec 01 13:39:05 user nova-compute[75288]:     <disk supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='diskDevice'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>disk</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cdrom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>floppy</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>lun</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='bus'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>fdc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sata</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </disk>
Dec 01 13:39:05 user nova-compute[75288]:     <graphics supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sdl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vnc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>spice</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egl-headless</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </graphics>
Dec 01 13:39:05 user nova-compute[75288]:     <video supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='modelType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cirrus</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vmvga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>qxl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>none</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>bochs</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ramfb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </video>
Dec 01 13:39:05 user nova-compute[75288]:     <hostdev supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='mode'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>subsystem</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='startupPolicy'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>default</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>mandatory</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>requisite</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>optional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='subsysType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pci</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='capsType'/>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='pciBackend'/>
Dec 01 13:39:05 user nova-compute[75288]:     </hostdev>
Dec 01 13:39:05 user nova-compute[75288]:     <rng supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>random</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egd</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>builtin</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </rng>
Dec 01 13:39:05 user nova-compute[75288]:     <filesystem supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='driverType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>path</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>handle</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtiofs</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </filesystem>
Dec 01 13:39:05 user nova-compute[75288]:     <tpm supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-tis</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-crb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>passthrough</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>emulator</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </tpm>
Dec 01 13:39:05 user nova-compute[75288]:   </devices>
Dec 01 13:39:05 user nova-compute[75288]:   <features>
Dec 01 13:39:05 user nova-compute[75288]:     <gic supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <genid supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backup supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <sev supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:   </features>
Dec 01 13:39:05 user nova-compute[75288]: </domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 01 13:39:05 user nova-compute[75288]: <domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 13:39:05 user nova-compute[75288]:   <domain>kvm</domain>
Dec 01 13:39:05 user nova-compute[75288]:   <machine>pc-i440fx-6.2</machine>
Dec 01 13:39:05 user nova-compute[75288]:   <arch>x86_64</arch>
Dec 01 13:39:05 user nova-compute[75288]:   <vcpu max='255'/>
Dec 01 13:39:05 user nova-compute[75288]:   <iothreads supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:   <os supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='firmware'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>efi</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:     <loader supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>rom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pflash</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='readonly'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='secure'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </loader>
Dec 01 13:39:05 user nova-compute[75288]:   </os>
Dec 01 13:39:05 user nova-compute[75288]:   <cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='maximumMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='invtsc'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='rsba'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>phenom</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>n270</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>core2duo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>athlon</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Westmere</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Penryn</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Opteron_G1</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Conroe</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>486</model>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:   </cpu>
Dec 01 13:39:05 user nova-compute[75288]:   <memoryBacking supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='sourceType'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>file</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>anonymous</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>memfd</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:   </memoryBacking>
Dec 01 13:39:05 user nova-compute[75288]:   <devices>
Dec 01 13:39:05 user nova-compute[75288]:     <disk supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='diskDevice'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>disk</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cdrom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>floppy</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>lun</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='bus'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ide</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>fdc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sata</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </disk>
Dec 01 13:39:05 user nova-compute[75288]:     <graphics supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sdl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vnc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>spice</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egl-headless</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </graphics>
Dec 01 13:39:05 user nova-compute[75288]:     <video supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='modelType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cirrus</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vmvga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>qxl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>none</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>bochs</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ramfb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </video>
Dec 01 13:39:05 user nova-compute[75288]:     <hostdev supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='mode'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>subsystem</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='startupPolicy'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>default</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>mandatory</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>requisite</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>optional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='subsysType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pci</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='capsType'/>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='pciBackend'/>
Dec 01 13:39:05 user nova-compute[75288]:     </hostdev>
Dec 01 13:39:05 user nova-compute[75288]:     <rng supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>random</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egd</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>builtin</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </rng>
Dec 01 13:39:05 user nova-compute[75288]:     <filesystem supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='driverType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>path</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>handle</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtiofs</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </filesystem>
Dec 01 13:39:05 user nova-compute[75288]:     <tpm supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-tis</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-crb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>passthrough</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>emulator</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </tpm>
Dec 01 13:39:05 user nova-compute[75288]:   </devices>
Dec 01 13:39:05 user nova-compute[75288]:   <features>
Dec 01 13:39:05 user nova-compute[75288]:     <gic supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <genid supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backup supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <sev supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:   </features>
Dec 01 13:39:05 user nova-compute[75288]: </domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 01 13:39:05 user nova-compute[75288]: <domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 13:39:05 user nova-compute[75288]:   <domain>kvm</domain>
Dec 01 13:39:05 user nova-compute[75288]:   <machine>pc-i440fx-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:   <arch>x86_64</arch>
Dec 01 13:39:05 user nova-compute[75288]:   <vcpu max='255'/>
Dec 01 13:39:05 user nova-compute[75288]:   <iothreads supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:   <os supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='firmware'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>efi</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:     <loader supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>rom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pflash</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='readonly'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='secure'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </loader>
Dec 01 13:39:05 user nova-compute[75288]:   </os>
Dec 01 13:39:05 user nova-compute[75288]:   <cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='maximumMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='invtsc'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='rsba'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>phenom</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>n270</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>core2duo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>athlon</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Westmere</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Penryn</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Opteron_G1</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Conroe</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>486</model>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:   </cpu>
Dec 01 13:39:05 user nova-compute[75288]:   <memoryBacking supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='sourceType'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>file</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>anonymous</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>memfd</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:   </memoryBacking>
Dec 01 13:39:05 user nova-compute[75288]:   <devices>
Dec 01 13:39:05 user nova-compute[75288]:     <disk supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='diskDevice'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>disk</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cdrom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>floppy</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>lun</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='bus'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ide</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>fdc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sata</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </disk>
Dec 01 13:39:05 user nova-compute[75288]:     <graphics supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sdl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vnc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>spice</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egl-headless</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </graphics>
Dec 01 13:39:05 user nova-compute[75288]:     <video supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='modelType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cirrus</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vmvga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>qxl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>none</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>bochs</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ramfb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </video>
Dec 01 13:39:05 user nova-compute[75288]:     <hostdev supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='mode'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>subsystem</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='startupPolicy'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>default</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>mandatory</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>requisite</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>optional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='subsysType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pci</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='capsType'/>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='pciBackend'/>
Dec 01 13:39:05 user nova-compute[75288]:     </hostdev>
Dec 01 13:39:05 user nova-compute[75288]:     <rng supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>random</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egd</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>builtin</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </rng>
Dec 01 13:39:05 user nova-compute[75288]:     <filesystem supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='driverType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>path</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>handle</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtiofs</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </filesystem>
Dec 01 13:39:05 user nova-compute[75288]:     <tpm supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-tis</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-crb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>passthrough</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>emulator</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </tpm>
Dec 01 13:39:05 user nova-compute[75288]:   </devices>
Dec 01 13:39:05 user nova-compute[75288]:   <features>
Dec 01 13:39:05 user nova-compute[75288]:     <gic supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <genid supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backup supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <sev supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:   </features>
Dec 01 13:39:05 user nova-compute[75288]: </domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 01 13:39:05 user nova-compute[75288]: <domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 13:39:05 user nova-compute[75288]:   <domain>kvm</domain>
Dec 01 13:39:05 user nova-compute[75288]:   <machine>pc-q35-jammy</machine>
Dec 01 13:39:05 user nova-compute[75288]:   <arch>x86_64</arch>
Dec 01 13:39:05 user nova-compute[75288]:   <vcpu max='288'/>
Dec 01 13:39:05 user nova-compute[75288]:   <iothreads supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:   <os supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='firmware'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>efi</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:     <loader supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>rom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pflash</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='readonly'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='secure'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>yes</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>no</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </loader>
Dec 01 13:39:05 user nova-compute[75288]:   </os>
Dec 01 13:39:05 user nova-compute[75288]:   <cpu>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-passthrough' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='hostPassthroughMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='maximum' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='maximumMigratable'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>on</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>off</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='host-model' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <vendor>Intel</vendor>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ss'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='vmx'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pcid'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='hypervisor'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arat'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='umip'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='md-clear'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='invtsc'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibpb'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='ibrs'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-stibp'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='rsba'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='erms'/>
Dec 01 13:39:05 user nova-compute[75288]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:     <mode name='custom' supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>qemu64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>qemu32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>phenom</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>pentium</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>n270</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm64</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>kvm32</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>coreduo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>core2duo</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>athlon</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Westmere</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Snowridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Skylake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>SandyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Penryn</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G5</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G4</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G3</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Opteron_G2</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Opteron_G1</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>IvyBridge</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Icelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Haswell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Rome</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-Milan</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>EPYC</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Dhyana</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cooperlake</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>Conroe</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='no'>Broadwell</model>
Dec 01 13:39:05 user nova-compute[75288]:       <model usable='yes'>486</model>
Dec 01 13:39:05 user nova-compute[75288]:     </mode>
Dec 01 13:39:05 user nova-compute[75288]:   </cpu>
Dec 01 13:39:05 user nova-compute[75288]:   <memoryBacking supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:     <enum name='sourceType'>
Dec 01 13:39:05 user nova-compute[75288]:       <value>file</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>anonymous</value>
Dec 01 13:39:05 user nova-compute[75288]:       <value>memfd</value>
Dec 01 13:39:05 user nova-compute[75288]:     </enum>
Dec 01 13:39:05 user nova-compute[75288]:   </memoryBacking>
Dec 01 13:39:05 user nova-compute[75288]:   <devices>
Dec 01 13:39:05 user nova-compute[75288]:     <disk supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='diskDevice'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>disk</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cdrom</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>floppy</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>lun</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='bus'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>fdc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sata</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </disk>
Dec 01 13:39:05 user nova-compute[75288]:     <graphics supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='type'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>sdl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vnc</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>spice</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egl-headless</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </graphics>
Dec 01 13:39:05 user nova-compute[75288]:     <video supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='modelType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>cirrus</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>vmvga</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>qxl</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>none</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>bochs</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>ramfb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </video>
Dec 01 13:39:05 user nova-compute[75288]:     <hostdev supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='mode'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>subsystem</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='startupPolicy'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>default</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>mandatory</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>requisite</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>optional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='subsysType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>usb</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>pci</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>scsi</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='capsType'/>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='pciBackend'/>
Dec 01 13:39:05 user nova-compute[75288]:     </hostdev>
Dec 01 13:39:05 user nova-compute[75288]:     <rng supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtio-non-transitional</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>random</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>egd</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>builtin</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </rng>
Dec 01 13:39:05 user nova-compute[75288]:     <filesystem supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='driverType'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>path</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>handle</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>virtiofs</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </filesystem>
Dec 01 13:39:05 user nova-compute[75288]:     <tpm supported='yes'>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='model'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-tis</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>tpm-crb</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:       <enum name='backendModel'>
Dec 01 13:39:05 user nova-compute[75288]:         <value>passthrough</value>
Dec 01 13:39:05 user nova-compute[75288]:         <value>emulator</value>
Dec 01 13:39:05 user nova-compute[75288]:       </enum>
Dec 01 13:39:05 user nova-compute[75288]:     </tpm>
Dec 01 13:39:05 user nova-compute[75288]:   </devices>
Dec 01 13:39:05 user nova-compute[75288]:   <features>
Dec 01 13:39:05 user nova-compute[75288]:     <gic supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:     <vmcoreinfo supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <genid supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backingStoreInput supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <backup supported='yes'/>
Dec 01 13:39:05 user nova-compute[75288]:     <sev supported='no'/>
Dec 01 13:39:05 user nova-compute[75288]:   </features>
Dec 01 13:39:05 user nova-compute[75288]: </domainCapabilities>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75288) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75288) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Checking secure boot support for host arch (x86_64) {{(pid=75288) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 01 13:39:05 user nova-compute[75288]: INFO nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Secure Boot support detected
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] cpu compare xml: <cpu match="exact">
Dec 01 13:39:05 user nova-compute[75288]:   <model>Nehalem</model>
Dec 01 13:39:05 user nova-compute[75288]: </cpu>
Dec 01 13:39:05 user nova-compute[75288]:  {{(pid=75288) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10017}}
Dec 01 13:39:05 user nova-compute[75288]: INFO nova.virt.node [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Generated node identity 6546d821-2196-4219-8f98-fc64fd991628
Dec 01 13:39:05 user nova-compute[75288]: INFO nova.virt.node [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Wrote node identity 6546d821-2196-4219-8f98-fc64fd991628 to /opt/stack/data/nova/compute_id
Dec 01 13:39:05 user nova-compute[75288]: WARNING nova.compute.manager [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Compute nodes ['6546d821-2196-4219-8f98-fc64fd991628'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 01 13:39:05 user nova-compute[75288]: INFO nova.compute.manager [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 01 13:39:05 user nova-compute[75288]: WARNING nova.compute.manager [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 01 13:39:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:39:05 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:39:05 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Hypervisor/Node resource view: name=user free_ram=10973MB free_disk=26.187015533447266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:39:05 user nova-compute[75288]: WARNING nova.compute.resource_tracker [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] No compute node record for user:6546d821-2196-4219-8f98-fc64fd991628: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6546d821-2196-4219-8f98-fc64fd991628 could not be found.
Dec 01 13:39:05 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Compute node record created for user:user with uuid: 6546d821-2196-4219-8f98-fc64fd991628
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:39:05 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:39:06 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] [req-2e2c6f28-854d-49e6-9822-20ac4455e05b] Created resource provider record via placement API for resource provider with UUID 6546d821-2196-4219-8f98-fc64fd991628 and name user.
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75288) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 01 13:39:06 user nova-compute[75288]: INFO nova.virt.libvirt.host [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] kernel doesn't support AMD SEV
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Libvirt baseline CPU <cpu>
Dec 01 13:39:06 user nova-compute[75288]:   <arch>x86_64</arch>
Dec 01 13:39:06 user nova-compute[75288]:   <model>Nehalem</model>
Dec 01 13:39:06 user nova-compute[75288]:   <vendor>Intel</vendor>
Dec 01 13:39:06 user nova-compute[75288]:   <topology sockets="6" cores="1" threads="1"/>
Dec 01 13:39:06 user nova-compute[75288]: </cpu>
Dec 01 13:39:06 user nova-compute[75288]:  {{(pid=75288) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12515}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Updated inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Updating resource provider 6546d821-2196-4219-8f98-fc64fd991628 generation from 0 to 1 during operation: update_inventory {{(pid=75288) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Updating resource provider 6546d821-2196-4219-8f98-fc64fd991628 generation from 1 to 2 during operation: update_traits {{(pid=75288) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.service [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Creating RPC server for service compute {{(pid=75288) start /opt/stack/nova/nova/service.py:182}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.service [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] Join ServiceGroup membership for this service compute {{(pid=75288) start /opt/stack/nova/nova/service.py:199}}
Dec 01 13:39:06 user nova-compute[75288]: DEBUG nova.servicegroup.drivers.db [None req-b6f3ebef-7e23-4d40-ad67-18bcb2e3ed9e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75288) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:40:06 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:40:06 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=10353MB free_disk=26.090621948242188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:40:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:40:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:40:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:40:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=10290MB free_disk=26.15506362915039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:40:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:40:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:40:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 13:40:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 13:40:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:40:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:41:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:41:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:41:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:41:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:41:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:41:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:41:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:42:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:42:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=10320MB free_disk=25.90740966796875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:42:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:42:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:42:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:43:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=9619MB free_disk=25.927997589111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:43:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "57c16213-db78-4d88-8171-260254bc943a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:10 user nova-compute[75288]: INFO nova.compute.claims [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Claim successful on node user
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.128s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:11 user nova-compute[75288]: INFO nova.compute.claims [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Claim successful on node user
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Creating image(s)
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "/opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "/opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "/opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Creating image(s)
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.policy [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8b600efb9d47b6991cbde8b34b9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fa93e7dad94355a81ee3193a26d19a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:11 user nova-compute[75288]: DEBUG nova.policy [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cad75165194843718ebc8b886ab3b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5854339bf9c4f3db4a3bf2c65ddc344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG nova.virt.images [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] 5960f30f-79c5-4c7d-9bd0-41d5142b4539 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a.part /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a.part /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a.converted" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.431s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:12 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsdda3u5i/privsep.sock']
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.222s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:12 user sudo[84541]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsdda3u5i/privsep.sock
Dec 01 13:43:12 user sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 13:43:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:13 user nova-compute[75288]: INFO nova.compute.claims [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Claim successful on node user
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Creating image(s)
Dec 01 13:43:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:13 user nova-compute[75288]: DEBUG nova.policy [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cad75165194843718ebc8b886ab3b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5854339bf9c4f3db4a3bf2c65ddc344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:14 user sudo[84541]: pam_unix(sudo:session): session closed for user root
Dec 01 13:43:14 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Spawned new privsep daemon via rootwrap
Dec 01 13:43:14 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 13:43:14 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 13:43:14 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 01 13:43:14 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84545
Dec 01 13:43:14 user nova-compute[75288]: WARNING oslo_privsep.priv_context [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] privsep daemon already running
Dec 01 13:43:14 user nova-compute[75288]: WARNING oslo_privsep.priv_context [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] privsep daemon already running
Dec 01 13:43:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Successfully created port: e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Successfully created port: 8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk 1073741824" returned: 0 in 0.050s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.229s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk 1073741824" returned: 0 in 0.043s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.484s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Cannot resize image /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Ensure instance console log exists: /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk 1073741824" returned: 0 in 0.043s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Cannot resize image /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Ensure instance console log exists: /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Cannot resize image /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Ensure instance console log exists: /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Successfully created port: c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Successfully updated port: 8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquired lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Successfully updated port: e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquired lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-de518219-5f76-4095-9c27-b49ee4c62649 req-7e9fe4c6-c0ea-43db-a329-fd4a07a62554 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-changed-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-de518219-5f76-4095-9c27-b49ee4c62649 req-7e9fe4c6-c0ea-43db-a329-fd4a07a62554 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Refreshing instance network info cache due to event network-changed-8805c728-e19f-4972-95cc-3873e12010d0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de518219-5f76-4095-9c27-b49ee4c62649 req-7e9fe4c6-c0ea-43db-a329-fd4a07a62554 service nova] Acquiring lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-1beb5ed1-de38-4b7b-b2db-95c878083c96 req-01a28a9f-68d6-437e-adc8-ac4498470b17 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received event network-changed-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-1beb5ed1-de38-4b7b-b2db-95c878083c96 req-01a28a9f-68d6-437e-adc8-ac4498470b17 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Refreshing instance network info cache due to event network-changed-e66de3d0-2331-4afa-8613-0cc8bc289deb. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1beb5ed1-de38-4b7b-b2db-95c878083c96 req-01a28a9f-68d6-437e-adc8-ac4498470b17 service nova] Acquiring lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Releasing lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance network_info: |[{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de518219-5f76-4095-9c27-b49ee4c62649 req-7e9fe4c6-c0ea-43db-a329-fd4a07a62554 service nova] Acquired lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-de518219-5f76-4095-9c27-b49ee4c62649 req-7e9fe4c6-c0ea-43db-a329-fd4a07a62554 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Refreshing network info cache for port 8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Start _get_guest_xml network_info=[{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2015631158',display_name='tempest-ServerRescueNegativeTestJSON-server-2015631158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2015631158',id=2,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-pw09zhis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:12Z,user_data=None,user_id='cad75165194843718ebc8b886ab3b6b7',uuid=57c16213-db78-4d88-8171-260254bc943a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3c:f3,bridge_name='br-int',has_traffic_filtering=True,id=8805c728-e19f-4972-95cc-3873e12010d0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8805c728-e1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'pci_devices' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:17 user nova-compute[75288]:   <uuid>57c16213-db78-4d88-8171-260254bc943a</uuid>
Dec 01 13:43:17 user nova-compute[75288]:   <name>instance-00000002</name>
Dec 01 13:43:17 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:17 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:17 user nova-compute[75288]:   <metadata>
Dec 01 13:43:17 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:17 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:17 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2015631158</nova:name>
Dec 01 13:43:17 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:17</nova:creationTime>
Dec 01 13:43:17 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:17 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:17 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:17 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:17 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:17 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:17 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:17 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:17 user nova-compute[75288]:         <nova:user uuid="cad75165194843718ebc8b886ab3b6b7">tempest-ServerRescueNegativeTestJSON-1340015149-project-member</nova:user>
Dec 01 13:43:17 user nova-compute[75288]:         <nova:project uuid="a5854339bf9c4f3db4a3bf2c65ddc344">tempest-ServerRescueNegativeTestJSON-1340015149</nova:project>
Dec 01 13:43:17 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:17 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:43:17 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:17 user nova-compute[75288]:         <nova:port uuid="8805c728-e19f-4972-95cc-3873e12010d0">
Dec 01 13:43:17 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 13:43:17 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:17 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:17 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:17 user nova-compute[75288]:   </metadata>
Dec 01 13:43:17 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:17 user nova-compute[75288]:     <system>
Dec 01 13:43:17 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:17 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:17 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:17 user nova-compute[75288]:       <entry name="serial">57c16213-db78-4d88-8171-260254bc943a</entry>
Dec 01 13:43:17 user nova-compute[75288]:       <entry name="uuid">57c16213-db78-4d88-8171-260254bc943a</entry>
Dec 01 13:43:17 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:17 user nova-compute[75288]:     </system>
Dec 01 13:43:17 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:17 user nova-compute[75288]:   <os>
Dec 01 13:43:17 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:17 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:17 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:17 user nova-compute[75288]:   </os>
Dec 01 13:43:17 user nova-compute[75288]:   <features>
Dec 01 13:43:17 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:17 user nova-compute[75288]:     <apic/>
Dec 01 13:43:17 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:17 user nova-compute[75288]:   </features>
Dec 01 13:43:17 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:17 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:17 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:17 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:17 user nova-compute[75288]:   </clock>
Dec 01 13:43:17 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:17 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:17 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:17 user nova-compute[75288]:   </cpu>
Dec 01 13:43:17 user nova-compute[75288]:   <devices>
Dec 01 13:43:17 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:17 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:17 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk"/>
Dec 01 13:43:17 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:43:17 user nova-compute[75288]:     </disk>
Dec 01 13:43:17 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:17 user nova-compute[75288]:       <mac address="fa:16:3e:5c:3c:f3"/>
Dec 01 13:43:17 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:17 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:17 user nova-compute[75288]:       <target dev="tap8805c728-e1"/>
Dec 01 13:43:17 user nova-compute[75288]:     </interface>
Dec 01 13:43:17 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:17 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/console.log" append="off"/>
Dec 01 13:43:17 user nova-compute[75288]:     </serial>
Dec 01 13:43:17 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:17 user nova-compute[75288]:     <video>
Dec 01 13:43:17 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:17 user nova-compute[75288]:     </video>
Dec 01 13:43:17 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:17 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:17 user nova-compute[75288]:     </rng>
Dec 01 13:43:17 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:17 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:17 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:17 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:17 user nova-compute[75288]:   </devices>
Dec 01 13:43:17 user nova-compute[75288]: </domain>
Dec 01 13:43:17 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2015631158',display_name='tempest-ServerRescueNegativeTestJSON-server-2015631158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2015631158',id=2,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-pw09zhis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:12Z,user_data=None,user_id='cad75165194843718ebc8b886ab3b6b7',uuid=57c16213-db78-4d88-8171-260254bc943a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3c:f3,bridge_name='br-int',has_traffic_filtering=True,id=8805c728-e19f-4972-95cc-3873e12010d0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8805c728-e1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG os_vif [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3c:f3,bridge_name='br-int',has_traffic_filtering=True,id=8805c728-e19f-4972-95cc-3873e12010d0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8805c728-e1') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Created schema index Interface.name {{(pid=75288) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Created schema index Port.name {{(pid=75288) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Created schema index Bridge.name {{(pid=75288) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Successfully updated port: c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [POLLOUT] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquired lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b47c6d99-e424-5d65-a489-8f94e56c379c', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:18 user nova-compute[75288]: INFO nova.compute.claims [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Claim successful on node user
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:18 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpfii9o9ih/privsep.sock']
Dec 01 13:43:18 user sudo[84645]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpfii9o9ih/privsep.sock
Dec 01 13:43:18 user sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Releasing lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Instance network_info: |[{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1beb5ed1-de38-4b7b-b2db-95c878083c96 req-01a28a9f-68d6-437e-adc8-ac4498470b17 service nova] Acquired lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-1beb5ed1-de38-4b7b-b2db-95c878083c96 req-01a28a9f-68d6-437e-adc8-ac4498470b17 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Refreshing network info cache for port e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Start _get_guest_xml network_info=[{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1856732204',display_name='tempest-ServerActionsTestOtherA-server-1856732204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1856732204',id=1,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-m116rm5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=03de2627-2167-48c9-94cb-bd57c18f87c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:9f:49,bridge_name='br-int',has_traffic_filtering=True,id=e66de3d0-2331-4afa-8613-0cc8bc289deb,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66de3d0-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'pci_devices' on Instance uuid 03de2627-2167-48c9-94cb-bd57c18f87c8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:18 user nova-compute[75288]:   <uuid>03de2627-2167-48c9-94cb-bd57c18f87c8</uuid>
Dec 01 13:43:18 user nova-compute[75288]:   <name>instance-00000001</name>
Dec 01 13:43:18 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:18 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:18 user nova-compute[75288]:   <metadata>
Dec 01 13:43:18 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:18 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:18 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherA-server-1856732204</nova:name>
Dec 01 13:43:18 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:18</nova:creationTime>
Dec 01 13:43:18 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:18 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:18 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:18 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:18 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:18 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:18 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:18 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:18 user nova-compute[75288]:         <nova:user uuid="5a8b600efb9d47b6991cbde8b34b9a1f">tempest-ServerActionsTestOtherA-1200563250-project-member</nova:user>
Dec 01 13:43:18 user nova-compute[75288]:         <nova:project uuid="85fa93e7dad94355a81ee3193a26d19a">tempest-ServerActionsTestOtherA-1200563250</nova:project>
Dec 01 13:43:18 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:18 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:43:18 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:18 user nova-compute[75288]:         <nova:port uuid="e66de3d0-2331-4afa-8613-0cc8bc289deb">
Dec 01 13:43:18 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 13:43:18 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:18 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:18 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:18 user nova-compute[75288]:   </metadata>
Dec 01 13:43:18 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:18 user nova-compute[75288]:     <system>
Dec 01 13:43:18 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:18 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:18 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:18 user nova-compute[75288]:       <entry name="serial">03de2627-2167-48c9-94cb-bd57c18f87c8</entry>
Dec 01 13:43:18 user nova-compute[75288]:       <entry name="uuid">03de2627-2167-48c9-94cb-bd57c18f87c8</entry>
Dec 01 13:43:18 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:18 user nova-compute[75288]:     </system>
Dec 01 13:43:18 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:18 user nova-compute[75288]:   <os>
Dec 01 13:43:18 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:18 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:18 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:18 user nova-compute[75288]:   </os>
Dec 01 13:43:18 user nova-compute[75288]:   <features>
Dec 01 13:43:18 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:18 user nova-compute[75288]:     <apic/>
Dec 01 13:43:18 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:18 user nova-compute[75288]:   </features>
Dec 01 13:43:18 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:18 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:18 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:18 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:18 user nova-compute[75288]:   </clock>
Dec 01 13:43:18 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:18 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:18 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:18 user nova-compute[75288]:   </cpu>
Dec 01 13:43:18 user nova-compute[75288]:   <devices>
Dec 01 13:43:18 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:18 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:18 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk"/>
Dec 01 13:43:18 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:43:18 user nova-compute[75288]:     </disk>
Dec 01 13:43:18 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:18 user nova-compute[75288]:       <mac address="fa:16:3e:f1:9f:49"/>
Dec 01 13:43:18 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:18 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:18 user nova-compute[75288]:       <target dev="tape66de3d0-23"/>
Dec 01 13:43:18 user nova-compute[75288]:     </interface>
Dec 01 13:43:18 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:18 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/console.log" append="off"/>
Dec 01 13:43:18 user nova-compute[75288]:     </serial>
Dec 01 13:43:18 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:18 user nova-compute[75288]:     <video>
Dec 01 13:43:18 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:18 user nova-compute[75288]:     </video>
Dec 01 13:43:18 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:18 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:18 user nova-compute[75288]:     </rng>
Dec 01 13:43:18 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:18 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:18 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:18 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:18 user nova-compute[75288]:   </devices>
Dec 01 13:43:18 user nova-compute[75288]: </domain>
Dec 01 13:43:18 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1856732204',display_name='tempest-ServerActionsTestOtherA-server-1856732204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1856732204',id=1,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-m116rm5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=03de2627-2167-48c9-94cb-bd57c18f87c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:9f:49,bridge_name='br-int',has_traffic_filtering=True,id=e66de3d0-2331-4afa-8613-0cc8bc289deb,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66de3d0-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG os_vif [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:9f:49,bridge_name='br-int',has_traffic_filtering=True,id=e66de3d0-2331-4afa-8613-0cc8bc289deb,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66de3d0-23') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '044e19f9-f558-5b1f-a265-ded8caaaa624', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Creating image(s)
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.policy [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f0219ef4ab742cdb27296abc211a120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8816f73a6346a9a973142c4af6d381', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-de518219-5f76-4095-9c27-b49ee4c62649 req-7e9fe4c6-c0ea-43db-a329-fd4a07a62554 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updated VIF entry in instance network info cache for port 8805c728-e19f-4972-95cc-3873e12010d0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-de518219-5f76-4095-9c27-b49ee4c62649 req-7e9fe4c6-c0ea-43db-a329-fd4a07a62554 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de518219-5f76-4095-9c27-b49ee4c62649 req-7e9fe4c6-c0ea-43db-a329-fd4a07a62554 service nova] Releasing lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updating instance_info_cache with network_info: [{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Releasing lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Instance network_info: |[{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Start _get_guest_xml network_info=[{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-799462005',display_name='tempest-ServerRescueNegativeTestJSON-server-799462005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-799462005',id=3,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-ymuw9f1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:14Z,user_data=None,user_id='cad75165194843718ebc8b886ab3b6b7',uuid=97df1bf5-d682-435b-9b70-7252770a3d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=c2b41ea4-c8ed-404e-845c-38adea30e710,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b41ea4-c8') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'pci_devices' on Instance uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:19 user nova-compute[75288]:   <uuid>97df1bf5-d682-435b-9b70-7252770a3d5a</uuid>
Dec 01 13:43:19 user nova-compute[75288]:   <name>instance-00000003</name>
Dec 01 13:43:19 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:19 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:19 user nova-compute[75288]:   <metadata>
Dec 01 13:43:19 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:19 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:19 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-799462005</nova:name>
Dec 01 13:43:19 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:19</nova:creationTime>
Dec 01 13:43:19 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:19 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:19 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:19 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:19 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:19 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:19 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:19 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:19 user nova-compute[75288]:         <nova:user uuid="cad75165194843718ebc8b886ab3b6b7">tempest-ServerRescueNegativeTestJSON-1340015149-project-member</nova:user>
Dec 01 13:43:19 user nova-compute[75288]:         <nova:project uuid="a5854339bf9c4f3db4a3bf2c65ddc344">tempest-ServerRescueNegativeTestJSON-1340015149</nova:project>
Dec 01 13:43:19 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:19 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:43:19 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:19 user nova-compute[75288]:         <nova:port uuid="c2b41ea4-c8ed-404e-845c-38adea30e710">
Dec 01 13:43:19 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 13:43:19 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:19 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:19 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:19 user nova-compute[75288]:   </metadata>
Dec 01 13:43:19 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:19 user nova-compute[75288]:     <system>
Dec 01 13:43:19 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:19 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:19 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:19 user nova-compute[75288]:       <entry name="serial">97df1bf5-d682-435b-9b70-7252770a3d5a</entry>
Dec 01 13:43:19 user nova-compute[75288]:       <entry name="uuid">97df1bf5-d682-435b-9b70-7252770a3d5a</entry>
Dec 01 13:43:19 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:19 user nova-compute[75288]:     </system>
Dec 01 13:43:19 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:19 user nova-compute[75288]:   <os>
Dec 01 13:43:19 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:19 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:19 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:19 user nova-compute[75288]:   </os>
Dec 01 13:43:19 user nova-compute[75288]:   <features>
Dec 01 13:43:19 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:19 user nova-compute[75288]:     <apic/>
Dec 01 13:43:19 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:19 user nova-compute[75288]:   </features>
Dec 01 13:43:19 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:19 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:19 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:19 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:19 user nova-compute[75288]:   </clock>
Dec 01 13:43:19 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:19 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:19 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:19 user nova-compute[75288]:   </cpu>
Dec 01 13:43:19 user nova-compute[75288]:   <devices>
Dec 01 13:43:19 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:19 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:19 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk"/>
Dec 01 13:43:19 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:43:19 user nova-compute[75288]:     </disk>
Dec 01 13:43:19 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:19 user nova-compute[75288]:       <mac address="fa:16:3e:6e:5d:2a"/>
Dec 01 13:43:19 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:19 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:19 user nova-compute[75288]:       <target dev="tapc2b41ea4-c8"/>
Dec 01 13:43:19 user nova-compute[75288]:     </interface>
Dec 01 13:43:19 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:19 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/console.log" append="off"/>
Dec 01 13:43:19 user nova-compute[75288]:     </serial>
Dec 01 13:43:19 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:19 user nova-compute[75288]:     <video>
Dec 01 13:43:19 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:19 user nova-compute[75288]:     </video>
Dec 01 13:43:19 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:19 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:19 user nova-compute[75288]:     </rng>
Dec 01 13:43:19 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:19 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:19 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:19 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:19 user nova-compute[75288]:   </devices>
Dec 01 13:43:19 user nova-compute[75288]: </domain>
Dec 01 13:43:19 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-799462005',display_name='tempest-ServerRescueNegativeTestJSON-server-799462005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-799462005',id=3,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-ymuw9f1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:14Z,user_data=None,user_id='cad75165194843718ebc8b886ab3b6b7',uuid=97df1bf5-d682-435b-9b70-7252770a3d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=c2b41ea4-c8ed-404e-845c-38adea30e710,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b41ea4-c8') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG os_vif [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=c2b41ea4-c8ed-404e-845c-38adea30e710,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b41ea4-c8') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2ad8bb3-c92e-519f-ad31-8dfcb1fd0481', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-668aa085-a2fd-4c7b-be3d-523466d502c0 req-860d0df6-3430-437b-a1c0-ccfe74ce6224 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-changed-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-668aa085-a2fd-4c7b-be3d-523466d502c0 req-860d0df6-3430-437b-a1c0-ccfe74ce6224 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Refreshing instance network info cache due to event network-changed-c2b41ea4-c8ed-404e-845c-38adea30e710. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-668aa085-a2fd-4c7b-be3d-523466d502c0 req-860d0df6-3430-437b-a1c0-ccfe74ce6224 service nova] Acquiring lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-668aa085-a2fd-4c7b-be3d-523466d502c0 req-860d0df6-3430-437b-a1c0-ccfe74ce6224 service nova] Acquired lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-668aa085-a2fd-4c7b-be3d-523466d502c0 req-860d0df6-3430-437b-a1c0-ccfe74ce6224 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Refreshing network info cache for port c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.231s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:19 user nova-compute[75288]: INFO nova.compute.claims [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Claim successful on node user
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk 1073741824" returned: 0 in 0.056s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:19 user sudo[84645]: pam_unix(sudo:session): session closed for user root
Dec 01 13:43:19 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Spawned new privsep daemon via rootwrap
Dec 01 13:43:19 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 13:43:19 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 13:43:19 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 01 13:43:19 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84653
Dec 01 13:43:19 user nova-compute[75288]: WARNING oslo_privsep.priv_context [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] privsep daemon already running
Dec 01 13:43:19 user nova-compute[75288]: WARNING oslo_privsep.priv_context [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] privsep daemon already running
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Cannot resize image /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Ensure instance console log exists: /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-1beb5ed1-de38-4b7b-b2db-95c878083c96 req-01a28a9f-68d6-437e-adc8-ac4498470b17 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updated VIF entry in instance network info cache for port e66de3d0-2331-4afa-8613-0cc8bc289deb. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-1beb5ed1-de38-4b7b-b2db-95c878083c96 req-01a28a9f-68d6-437e-adc8-ac4498470b17 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1beb5ed1-de38-4b7b-b2db-95c878083c96 req-01a28a9f-68d6-437e-adc8-ac4498470b17 service nova] Releasing lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Creating image(s)
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "/opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "/opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2b41ea4-c8, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2b41ea4-c8, col_values=(('qos', UUID('1a7eb476-d48f-49d2-84dd-1a53a8e3d83d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2b41ea4-c8, col_values=(('external_ids', {'iface-id': 'c2b41ea4-c8ed-404e-845c-38adea30e710', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:5d:2a', 'vm-uuid': '97df1bf5-d682-435b-9b70-7252770a3d5a'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape66de3d0-23, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape66de3d0-23, col_values=(('qos', UUID('a9127828-6d8b-4d0f-8bb9-ea89a06642d3')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape66de3d0-23, col_values=(('external_ids', {'iface-id': 'e66de3d0-2331-4afa-8613-0cc8bc289deb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:9f:49', 'vm-uuid': '03de2627-2167-48c9-94cb-bd57c18f87c8'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: INFO os_vif [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=c2b41ea4-c8ed-404e-845c-38adea30e710,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b41ea4-c8')
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: INFO os_vif [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:9f:49,bridge_name='br-int',has_traffic_filtering=True,id=e66de3d0-2331-4afa-8613-0cc8bc289deb,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66de3d0-23')
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8805c728-e1, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8805c728-e1, col_values=(('qos', UUID('1c8db7a9-9ea1-4651-88e8-f8b420210df3')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8805c728-e1, col_values=(('external_ids', {'iface-id': '8805c728-e19f-4972-95cc-3873e12010d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:3c:f3', 'vm-uuid': '57c16213-db78-4d88-8171-260254bc943a'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:20 user nova-compute[75288]: INFO os_vif [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:3c:f3,bridge_name='br-int',has_traffic_filtering=True,id=8805c728-e19f-4972-95cc-3873e12010d0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8805c728-e1')
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No VIF found with MAC fa:16:3e:6e:5d:2a, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No VIF found with MAC fa:16:3e:f1:9f:49, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.policy [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b7739fa771e43c6b503e89ff7de7221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd88f5d625df4e6dadf00024d504d6d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No VIF found with MAC fa:16:3e:5c:3c:f3, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk 1073741824" returned: 0 in 0.042s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.network.neutron [req-668aa085-a2fd-4c7b-be3d-523466d502c0 req-860d0df6-3430-437b-a1c0-ccfe74ce6224 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updated VIF entry in instance network info cache for port c2b41ea4-c8ed-404e-845c-38adea30e710. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.network.neutron [req-668aa085-a2fd-4c7b-be3d-523466d502c0 req-860d0df6-3430-437b-a1c0-ccfe74ce6224 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updating instance_info_cache with network_info: [{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-668aa085-a2fd-4c7b-be3d-523466d502c0 req-860d0df6-3430-437b-a1c0-ccfe74ce6224 service nova] Releasing lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Cannot resize image /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Ensure instance console log exists: /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Successfully created port: e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Successfully updated port: e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquired lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Successfully created port: 94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-89ca1f9f-fdd0-4b01-9db6-31c6b486dccd req-0cd2cbf6-975d-4835-b36a-2e6306bff5ad service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-changed-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-89ca1f9f-fdd0-4b01-9db6-31c6b486dccd req-0cd2cbf6-975d-4835-b36a-2e6306bff5ad service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Refreshing instance network info cache due to event network-changed-e41a567f-0fb6-4089-b693-d8d527576a17. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-89ca1f9f-fdd0-4b01-9db6-31c6b486dccd req-0cd2cbf6-975d-4835-b36a-2e6306bff5ad service nova] Acquiring lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Releasing lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance network_info: |[{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-89ca1f9f-fdd0-4b01-9db6-31c6b486dccd req-0cd2cbf6-975d-4835-b36a-2e6306bff5ad service nova] Acquired lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-89ca1f9f-fdd0-4b01-9db6-31c6b486dccd req-0cd2cbf6-975d-4835-b36a-2e6306bff5ad service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Refreshing network info cache for port e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Start _get_guest_xml network_info=[{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1274625653',display_name='tempest-ServerStableDeviceRescueTest-server-1274625653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1274625653',id=4,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfA+ZDO7xALSyEhCRvYLfQ+xYp3su3wJdrLeQt71rSzduiAJ0Kj9QHOIOMdGWpjCmn0eSrw/Ozpvfaqj/WbpdwfUSNZlYZrAJSO6YTtD/s2q0XiPWvAb1X5yuNUVqfqiQ==',key_name='tempest-keypair-1837351537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8816f73a6346a9a973142c4af6d381',ramdisk_id='',reservation_id='r-zsc9kejp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-918439040',owner_user_name='tempest-ServerStableDeviceRescueTest-918439040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f0219ef4ab742cdb27296abc211a120',uuid=f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Converting VIF {"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4d:a9,bridge_name='br-int',has_traffic_filtering=True,id=e41a567f-0fb6-4089-b693-d8d527576a17,network=Network(98055b13-feb2-4087-a8ea-124ab71ba571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41a567f-0f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'pci_devices' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:23 user nova-compute[75288]:   <uuid>f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af</uuid>
Dec 01 13:43:23 user nova-compute[75288]:   <name>instance-00000004</name>
Dec 01 13:43:23 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:23 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:23 user nova-compute[75288]:   <metadata>
Dec 01 13:43:23 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:23 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:23 user nova-compute[75288]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1274625653</nova:name>
Dec 01 13:43:23 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:22</nova:creationTime>
Dec 01 13:43:23 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:23 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:23 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:23 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:23 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:23 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:23 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:23 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:23 user nova-compute[75288]:         <nova:user uuid="1f0219ef4ab742cdb27296abc211a120">tempest-ServerStableDeviceRescueTest-918439040-project-member</nova:user>
Dec 01 13:43:23 user nova-compute[75288]:         <nova:project uuid="bf8816f73a6346a9a973142c4af6d381">tempest-ServerStableDeviceRescueTest-918439040</nova:project>
Dec 01 13:43:23 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:23 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:43:23 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:23 user nova-compute[75288]:         <nova:port uuid="e41a567f-0fb6-4089-b693-d8d527576a17">
Dec 01 13:43:23 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:43:23 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:23 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:23 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:23 user nova-compute[75288]:   </metadata>
Dec 01 13:43:23 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:23 user nova-compute[75288]:     <system>
Dec 01 13:43:23 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:23 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:23 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:23 user nova-compute[75288]:       <entry name="serial">f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af</entry>
Dec 01 13:43:23 user nova-compute[75288]:       <entry name="uuid">f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af</entry>
Dec 01 13:43:23 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:23 user nova-compute[75288]:     </system>
Dec 01 13:43:23 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:23 user nova-compute[75288]:   <os>
Dec 01 13:43:23 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:23 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:23 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:23 user nova-compute[75288]:   </os>
Dec 01 13:43:23 user nova-compute[75288]:   <features>
Dec 01 13:43:23 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:23 user nova-compute[75288]:     <apic/>
Dec 01 13:43:23 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:23 user nova-compute[75288]:   </features>
Dec 01 13:43:23 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:23 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:23 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:23 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:23 user nova-compute[75288]:   </clock>
Dec 01 13:43:23 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:23 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:23 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:23 user nova-compute[75288]:   </cpu>
Dec 01 13:43:23 user nova-compute[75288]:   <devices>
Dec 01 13:43:23 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:23 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:23 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk"/>
Dec 01 13:43:23 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:43:23 user nova-compute[75288]:     </disk>
Dec 01 13:43:23 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:23 user nova-compute[75288]:       <mac address="fa:16:3e:eb:4d:a9"/>
Dec 01 13:43:23 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:23 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:23 user nova-compute[75288]:       <target dev="tape41a567f-0f"/>
Dec 01 13:43:23 user nova-compute[75288]:     </interface>
Dec 01 13:43:23 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:23 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/console.log" append="off"/>
Dec 01 13:43:23 user nova-compute[75288]:     </serial>
Dec 01 13:43:23 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:23 user nova-compute[75288]:     <video>
Dec 01 13:43:23 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:23 user nova-compute[75288]:     </video>
Dec 01 13:43:23 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:23 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:23 user nova-compute[75288]:     </rng>
Dec 01 13:43:23 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:23 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:23 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:23 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:23 user nova-compute[75288]:   </devices>
Dec 01 13:43:23 user nova-compute[75288]: </domain>
Dec 01 13:43:23 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1274625653',display_name='tempest-ServerStableDeviceRescueTest-server-1274625653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1274625653',id=4,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfA+ZDO7xALSyEhCRvYLfQ+xYp3su3wJdrLeQt71rSzduiAJ0Kj9QHOIOMdGWpjCmn0eSrw/Ozpvfaqj/WbpdwfUSNZlYZrAJSO6YTtD/s2q0XiPWvAb1X5yuNUVqfqiQ==',key_name='tempest-keypair-1837351537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8816f73a6346a9a973142c4af6d381',ramdisk_id='',reservation_id='r-zsc9kejp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-918439040',owner_user_name='tempest-ServerStableDeviceRescueTest-918439040-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f0219ef4ab742cdb27296abc211a120',uuid=f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Converting VIF {"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4d:a9,bridge_name='br-int',has_traffic_filtering=True,id=e41a567f-0fb6-4089-b693-d8d527576a17,network=Network(98055b13-feb2-4087-a8ea-124ab71ba571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41a567f-0f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG os_vif [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4d:a9,bridge_name='br-int',has_traffic_filtering=True,id=e41a567f-0fb6-4089-b693-d8d527576a17,network=Network(98055b13-feb2-4087-a8ea-124ab71ba571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41a567f-0f') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4053e5d-c760-53aa-a50e-7522e95200c4', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape41a567f-0f, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape41a567f-0f, col_values=(('qos', UUID('f6637bc1-adf9-45b5-9c2d-931f8a1a17ca')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape41a567f-0f, col_values=(('external_ids', {'iface-id': 'e41a567f-0fb6-4089-b693-d8d527576a17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:4d:a9', 'vm-uuid': 'f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: INFO os_vif [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4d:a9,bridge_name='br-int',has_traffic_filtering=True,id=e41a567f-0fb6-4089-b693-d8d527576a17,network=Network(98055b13-feb2-4087-a8ea-124ab71ba571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41a567f-0f')
Dec 01 13:43:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No VIF found with MAC fa:16:3e:eb:4d:a9, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-89ca1f9f-fdd0-4b01-9db6-31c6b486dccd req-0cd2cbf6-975d-4835-b36a-2e6306bff5ad service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updated VIF entry in instance network info cache for port e41a567f-0fb6-4089-b693-d8d527576a17. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-89ca1f9f-fdd0-4b01-9db6-31c6b486dccd req-0cd2cbf6-975d-4835-b36a-2e6306bff5ad service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-89ca1f9f-fdd0-4b01-9db6-31c6b486dccd req-0cd2cbf6-975d-4835-b36a-2e6306bff5ad service nova] Releasing lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Successfully updated port: 94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquired lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-8f4f878a-ea31-4034-95b9-1cd00c57cd62 req-9dad63b1-8f1b-4c1b-9708-91b7122ebd07 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received event network-changed-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-8f4f878a-ea31-4034-95b9-1cd00c57cd62 req-9dad63b1-8f1b-4c1b-9708-91b7122ebd07 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Refreshing instance network info cache due to event network-changed-94a9b395-6933-43ea-89a6-77157cac1f75. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f4f878a-ea31-4034-95b9-1cd00c57cd62 req-9dad63b1-8f1b-4c1b-9708-91b7122ebd07 service nova] Acquiring lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating instance_info_cache with network_info: [{"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Releasing lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance network_info: |[{"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f4f878a-ea31-4034-95b9-1cd00c57cd62 req-9dad63b1-8f1b-4c1b-9708-91b7122ebd07 service nova] Acquired lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-8f4f878a-ea31-4034-95b9-1cd00c57cd62 req-9dad63b1-8f1b-4c1b-9708-91b7122ebd07 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Refreshing network info cache for port 94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Start _get_guest_xml network_info=[{"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-745559289',display_name='tempest-ServerActionsTestOtherB-server-745559289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-745559289',id=5,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzL1MpDodMkY+xvBqITOaLy5oBm4DD5VJVvVNoHnn6Mtxt7m0WXVws5RbvQGMPz+LPvt+IaVJRN4WJicpVCtlvPZ8kIrh2x/RVC8OCU5xD58QPVXNLfLtbDizY9sQOGnQ==',key_name='tempest-keypair-1567478084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd88f5d625df4e6dadf00024d504d6d1',ramdisk_id='',reservation_id='r-dxvhm1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-497654762',owner_user_name='tempest-ServerActionsTestOtherB-497654762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b7739fa771e43c6b503e89ff7de7221',uuid=2c66ff7f-d0d9-43ff-98a4-bb702780e080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Converting VIF {"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c66ff7f-d0d9-43ff-98a4-bb702780e080 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:25 user nova-compute[75288]:   <uuid>2c66ff7f-d0d9-43ff-98a4-bb702780e080</uuid>
Dec 01 13:43:25 user nova-compute[75288]:   <name>instance-00000005</name>
Dec 01 13:43:25 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:25 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:25 user nova-compute[75288]:   <metadata>
Dec 01 13:43:25 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:25 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:25 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherB-server-745559289</nova:name>
Dec 01 13:43:25 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:25</nova:creationTime>
Dec 01 13:43:25 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:25 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:25 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:25 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:25 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:25 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:25 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:25 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:25 user nova-compute[75288]:         <nova:user uuid="0b7739fa771e43c6b503e89ff7de7221">tempest-ServerActionsTestOtherB-497654762-project-member</nova:user>
Dec 01 13:43:25 user nova-compute[75288]:         <nova:project uuid="fd88f5d625df4e6dadf00024d504d6d1">tempest-ServerActionsTestOtherB-497654762</nova:project>
Dec 01 13:43:25 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:25 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:43:25 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:25 user nova-compute[75288]:         <nova:port uuid="94a9b395-6933-43ea-89a6-77157cac1f75">
Dec 01 13:43:25 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:43:25 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:25 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:25 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:25 user nova-compute[75288]:   </metadata>
Dec 01 13:43:25 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:25 user nova-compute[75288]:     <system>
Dec 01 13:43:25 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:25 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:25 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:25 user nova-compute[75288]:       <entry name="serial">2c66ff7f-d0d9-43ff-98a4-bb702780e080</entry>
Dec 01 13:43:25 user nova-compute[75288]:       <entry name="uuid">2c66ff7f-d0d9-43ff-98a4-bb702780e080</entry>
Dec 01 13:43:25 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:25 user nova-compute[75288]:     </system>
Dec 01 13:43:25 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:25 user nova-compute[75288]:   <os>
Dec 01 13:43:25 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:25 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:25 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:25 user nova-compute[75288]:   </os>
Dec 01 13:43:25 user nova-compute[75288]:   <features>
Dec 01 13:43:25 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:25 user nova-compute[75288]:     <apic/>
Dec 01 13:43:25 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:25 user nova-compute[75288]:   </features>
Dec 01 13:43:25 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:25 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:25 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:25 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:25 user nova-compute[75288]:   </clock>
Dec 01 13:43:25 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:25 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:25 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:25 user nova-compute[75288]:   </cpu>
Dec 01 13:43:25 user nova-compute[75288]:   <devices>
Dec 01 13:43:25 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:25 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:25 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk"/>
Dec 01 13:43:25 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:43:25 user nova-compute[75288]:     </disk>
Dec 01 13:43:25 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:25 user nova-compute[75288]:       <mac address="fa:16:3e:1f:93:0b"/>
Dec 01 13:43:25 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:25 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:25 user nova-compute[75288]:       <target dev="tap94a9b395-69"/>
Dec 01 13:43:25 user nova-compute[75288]:     </interface>
Dec 01 13:43:25 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:25 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/console.log" append="off"/>
Dec 01 13:43:25 user nova-compute[75288]:     </serial>
Dec 01 13:43:25 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:25 user nova-compute[75288]:     <video>
Dec 01 13:43:25 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:25 user nova-compute[75288]:     </video>
Dec 01 13:43:25 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:25 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:25 user nova-compute[75288]:     </rng>
Dec 01 13:43:25 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:25 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:25 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:25 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:25 user nova-compute[75288]:   </devices>
Dec 01 13:43:25 user nova-compute[75288]: </domain>
Dec 01 13:43:25 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-745559289',display_name='tempest-ServerActionsTestOtherB-server-745559289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-745559289',id=5,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzL1MpDodMkY+xvBqITOaLy5oBm4DD5VJVvVNoHnn6Mtxt7m0WXVws5RbvQGMPz+LPvt+IaVJRN4WJicpVCtlvPZ8kIrh2x/RVC8OCU5xD58QPVXNLfLtbDizY9sQOGnQ==',key_name='tempest-keypair-1567478084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd88f5d625df4e6dadf00024d504d6d1',ramdisk_id='',reservation_id='r-dxvhm1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-497654762',owner_user_name='tempest-ServerActionsTestOtherB-497654762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b7739fa771e43c6b503e89ff7de7221',uuid=2c66ff7f-d0d9-43ff-98a4-bb702780e080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Converting VIF {"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG os_vif [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6d6deb5-eb44-5270-bdd2-7cd624da9913', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94a9b395-69, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94a9b395-69, col_values=(('qos', UUID('448198af-3a22-4470-a0db-21ebcc033d8c')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94a9b395-69, col_values=(('external_ids', {'iface-id': '94a9b395-6933-43ea-89a6-77157cac1f75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:93:0b', 'vm-uuid': '2c66ff7f-d0d9-43ff-98a4-bb702780e080'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:25 user nova-compute[75288]: INFO os_vif [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69')
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] No VIF found with MAC fa:16:3e:1f:93:0b, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:26 user nova-compute[75288]: DEBUG nova.network.neutron [req-8f4f878a-ea31-4034-95b9-1cd00c57cd62 req-9dad63b1-8f1b-4c1b-9708-91b7122ebd07 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updated VIF entry in instance network info cache for port 94a9b395-6933-43ea-89a6-77157cac1f75. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:26 user nova-compute[75288]: DEBUG nova.network.neutron [req-8f4f878a-ea31-4034-95b9-1cd00c57cd62 req-9dad63b1-8f1b-4c1b-9708-91b7122ebd07 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating instance_info_cache with network_info: [{"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f4f878a-ea31-4034-95b9-1cd00c57cd62 req-9dad63b1-8f1b-4c1b-9708-91b7122ebd07 service nova] Releasing lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Instance spawned successfully.
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:28 user nova-compute[75288]: INFO nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Took 16.90 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:28 user nova-compute[75288]: INFO nova.compute.manager [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Took 18.14 seconds to build instance.
Dec 01 13:43:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a3ab2bc-d19f-4b26-94fc-7e3b5588ac87 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.379s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance spawned successfully.
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:29 user nova-compute[75288]: INFO nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Took 17.66 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:29 user nova-compute[75288]: INFO nova.compute.manager [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Took 18.77 seconds to build instance.
Dec 01 13:43:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ed101d7b-9a3c-487e-9e94-377037f1776c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "57c16213-db78-4d88-8171-260254bc943a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Instance spawned successfully.
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:30 user nova-compute[75288]: INFO nova.compute.claims [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Claim successful on node user
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:30 user nova-compute[75288]: INFO nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Took 16.56 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:30 user nova-compute[75288]: INFO nova.compute.manager [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Took 17.51 seconds to build instance.
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-8939a9b2-f90d-422d-95fc-19582866636b req-182daa96-057c-452d-aea8-ec227f978aed service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8939a9b2-f90d-422d-95fc-19582866636b req-182daa96-057c-452d-aea8-ec227f978aed service nova] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8939a9b2-f90d-422d-95fc-19582866636b req-182daa96-057c-452d-aea8-ec227f978aed service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8939a9b2-f90d-422d-95fc-19582866636b req-182daa96-057c-452d-aea8-ec227f978aed service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-8939a9b2-f90d-422d-95fc-19582866636b req-182daa96-057c-452d-aea8-ec227f978aed service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] No waiting events found dispatching network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:30 user nova-compute[75288]: WARNING nova.compute.manager [req-8939a9b2-f90d-422d-95fc-19582866636b req-182daa96-057c-452d-aea8-ec227f978aed service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received unexpected event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 for instance with vm_state active and task_state None.
Dec 01 13:43:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-86952ad6-dd78-4014-ad80-1ec6955aca5e tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.912s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance spawned successfully.
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.028s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance spawned successfully.
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:31 user nova-compute[75288]: INFO nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Took 12.72 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:31 user nova-compute[75288]: DEBUG nova.policy [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2de2c848885545cab7ce9c7f0ee7f948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d84360718549bba2baea876c19a537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:32 user nova-compute[75288]: INFO nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Took 12.00 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:32 user nova-compute[75288]: INFO nova.compute.manager [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Took 14.31 seconds to build instance.
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Creating image(s)
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "/opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "/opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9f0c8a48-88be-4b5f-b2ae-ec7fe6ae32fb tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.609s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:32 user nova-compute[75288]: INFO nova.compute.manager [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Took 13.08 seconds to build instance.
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2041758-353b-461f-a317-df460319742f tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.391s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.492s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] No waiting events found dispatching network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:32 user nova-compute[75288]: WARNING nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received unexpected event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 for instance with vm_state active and task_state None.
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received event network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] No waiting events found dispatching network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:32 user nova-compute[75288]: WARNING nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received unexpected event network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb for instance with vm_state active and task_state None.
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received event network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] No waiting events found dispatching network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:32 user nova-compute[75288]: WARNING nova.compute.manager [req-a66dc17f-f350-48c2-8df0-ebb893c0e18c req-32a41b1e-947b-47fa-9a6b-5f44b02a3737 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received unexpected event network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb for instance with vm_state active and task_state None.
Dec 01 13:43:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.462s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk 1073741824" returned: 0 in 0.302s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.770s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.248s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:33 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json" returned: 0 in 0.349s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Cannot resize image /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Ensure instance console log exists: /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:34 user nova-compute[75288]: INFO nova.compute.claims [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Claim successful on node user
Dec 01 13:43:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Successfully created port: 92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:34 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:35 user nova-compute[75288]: WARNING nova.compute.manager [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state active and task_state None.
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:35 user nova-compute[75288]: WARNING nova.compute.manager [req-6eb30669-098e-402f-bfa7-bc6e83a984a8 req-01a356d5-74bd-41ac-8582-79c497e159fb service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state active and task_state None.
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.704s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.policy [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b14b041e05644358b3365ca675a93cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d820dd1ad9d42229c9537044fd32cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Creating image(s)
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "/opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "/opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.072s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.263s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.242s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk 1073741824" returned: 0 in 0.058s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Successfully updated port: 92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquired lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.292s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Cannot resize image /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Ensure instance console log exists: /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Successfully created port: 36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-1e4702a1-9d80-496d-932b-24798e432c1e req-a0e6be62-4f75-4543-b719-2838b7aacbe4 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received event network-changed-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-1e4702a1-9d80-496d-932b-24798e432c1e req-a0e6be62-4f75-4543-b719-2838b7aacbe4 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Refreshing instance network info cache due to event network-changed-92d8f57c-0605-4509-abe5-e66257f43917. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1e4702a1-9d80-496d-932b-24798e432c1e req-a0e6be62-4f75-4543-b719-2838b7aacbe4 service nova] Acquiring lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Updating instance_info_cache with network_info: [{"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Releasing lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Instance network_info: |[{"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1e4702a1-9d80-496d-932b-24798e432c1e req-a0e6be62-4f75-4543-b719-2838b7aacbe4 service nova] Acquired lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-1e4702a1-9d80-496d-932b-24798e432c1e req-a0e6be62-4f75-4543-b719-2838b7aacbe4 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Refreshing network info cache for port 92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Start _get_guest_xml network_info=[{"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1822688833',display_name='tempest-TestVolumeSwap-server-1822688833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1822688833',id=6,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGbsDQvKG9hSVFFvi+4weDaFn+XTlHkOV5fZr1dxhPdm6EJ9A64G568xVIleS8NxvCAmFg/YuB4lVxXS+wUN37RfAWZoAGrUx9CVqwulWiFt9w/CvWn1fRaor/1IT5VaQ==',key_name='tempest-keypair-1889675105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d84360718549bba2baea876c19a537',ramdisk_id='',reservation_id='r-8zffgp78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-463243492',owner_user_name='tempest-TestVolumeSwap-463243492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2de2c848885545cab7ce9c7f0ee7f948',uuid=d6528740-f062-4dd6-9b99-d41042e2abe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Converting VIF {"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=92d8f57c-0605-4509-abe5-e66257f43917,network=Network(582e865e-37c8-4bdb-baa9-d9878eff0c3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d8f57c-06') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lazy-loading 'pci_devices' on Instance uuid d6528740-f062-4dd6-9b99-d41042e2abe4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:37 user nova-compute[75288]:   <uuid>d6528740-f062-4dd6-9b99-d41042e2abe4</uuid>
Dec 01 13:43:37 user nova-compute[75288]:   <name>instance-00000006</name>
Dec 01 13:43:37 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:37 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:37 user nova-compute[75288]:   <metadata>
Dec 01 13:43:37 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:37 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:37 user nova-compute[75288]:       <nova:name>tempest-TestVolumeSwap-server-1822688833</nova:name>
Dec 01 13:43:37 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:37</nova:creationTime>
Dec 01 13:43:37 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:37 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:37 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:37 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:37 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:37 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:37 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:37 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:37 user nova-compute[75288]:         <nova:user uuid="2de2c848885545cab7ce9c7f0ee7f948">tempest-TestVolumeSwap-463243492-project-member</nova:user>
Dec 01 13:43:37 user nova-compute[75288]:         <nova:project uuid="36d84360718549bba2baea876c19a537">tempest-TestVolumeSwap-463243492</nova:project>
Dec 01 13:43:37 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:37 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:43:37 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:37 user nova-compute[75288]:         <nova:port uuid="92d8f57c-0605-4509-abe5-e66257f43917">
Dec 01 13:43:37 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:43:37 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:37 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:37 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:37 user nova-compute[75288]:   </metadata>
Dec 01 13:43:37 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:37 user nova-compute[75288]:     <system>
Dec 01 13:43:37 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:37 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:37 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:37 user nova-compute[75288]:       <entry name="serial">d6528740-f062-4dd6-9b99-d41042e2abe4</entry>
Dec 01 13:43:37 user nova-compute[75288]:       <entry name="uuid">d6528740-f062-4dd6-9b99-d41042e2abe4</entry>
Dec 01 13:43:37 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:37 user nova-compute[75288]:     </system>
Dec 01 13:43:37 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:37 user nova-compute[75288]:   <os>
Dec 01 13:43:37 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:37 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:37 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:37 user nova-compute[75288]:   </os>
Dec 01 13:43:37 user nova-compute[75288]:   <features>
Dec 01 13:43:37 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:37 user nova-compute[75288]:     <apic/>
Dec 01 13:43:37 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:37 user nova-compute[75288]:   </features>
Dec 01 13:43:37 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:37 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:37 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:37 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:37 user nova-compute[75288]:   </clock>
Dec 01 13:43:37 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:37 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:37 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:37 user nova-compute[75288]:   </cpu>
Dec 01 13:43:37 user nova-compute[75288]:   <devices>
Dec 01 13:43:37 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:37 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:37 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk"/>
Dec 01 13:43:37 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:43:37 user nova-compute[75288]:     </disk>
Dec 01 13:43:37 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:37 user nova-compute[75288]:       <mac address="fa:16:3e:b3:8e:fc"/>
Dec 01 13:43:37 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:37 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:37 user nova-compute[75288]:       <target dev="tap92d8f57c-06"/>
Dec 01 13:43:37 user nova-compute[75288]:     </interface>
Dec 01 13:43:37 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:37 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/console.log" append="off"/>
Dec 01 13:43:37 user nova-compute[75288]:     </serial>
Dec 01 13:43:37 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:37 user nova-compute[75288]:     <video>
Dec 01 13:43:37 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:37 user nova-compute[75288]:     </video>
Dec 01 13:43:37 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:37 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:37 user nova-compute[75288]:     </rng>
Dec 01 13:43:37 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:37 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:37 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:37 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:37 user nova-compute[75288]:   </devices>
Dec 01 13:43:37 user nova-compute[75288]: </domain>
Dec 01 13:43:37 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1822688833',display_name='tempest-TestVolumeSwap-server-1822688833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1822688833',id=6,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGbsDQvKG9hSVFFvi+4weDaFn+XTlHkOV5fZr1dxhPdm6EJ9A64G568xVIleS8NxvCAmFg/YuB4lVxXS+wUN37RfAWZoAGrUx9CVqwulWiFt9w/CvWn1fRaor/1IT5VaQ==',key_name='tempest-keypair-1889675105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36d84360718549bba2baea876c19a537',ramdisk_id='',reservation_id='r-8zffgp78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-463243492',owner_user_name='tempest-TestVolumeSwap-463243492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2de2c848885545cab7ce9c7f0ee7f948',uuid=d6528740-f062-4dd6-9b99-d41042e2abe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Converting VIF {"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=92d8f57c-0605-4509-abe5-e66257f43917,network=Network(582e865e-37c8-4bdb-baa9-d9878eff0c3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d8f57c-06') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG os_vif [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=92d8f57c-0605-4509-abe5-e66257f43917,network=Network(582e865e-37c8-4bdb-baa9-d9878eff0c3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d8f57c-06') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e506ff8a-91f6-55c2-bcae-a65f23c91fb5', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92d8f57c-06, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92d8f57c-06, col_values=(('qos', UUID('d4109a61-3ae7-418b-81b7-5f9fbaf63a25')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92d8f57c-06, col_values=(('external_ids', {'iface-id': '92d8f57c-0605-4509-abe5-e66257f43917', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:8e:fc', 'vm-uuid': 'd6528740-f062-4dd6-9b99-d41042e2abe4'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:37 user nova-compute[75288]: INFO os_vif [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=92d8f57c-0605-4509-abe5-e66257f43917,network=Network(582e865e-37c8-4bdb-baa9-d9878eff0c3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d8f57c-06')
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] No VIF found with MAC fa:16:3e:b3:8e:fc, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Successfully updated port: 36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquired lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-1e4702a1-9d80-496d-932b-24798e432c1e req-a0e6be62-4f75-4543-b719-2838b7aacbe4 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Updated VIF entry in instance network info cache for port 92d8f57c-0605-4509-abe5-e66257f43917. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-1e4702a1-9d80-496d-932b-24798e432c1e req-a0e6be62-4f75-4543-b719-2838b7aacbe4 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Updating instance_info_cache with network_info: [{"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-60ef470d-e380-4409-bcb8-54f9e809e089 req-79c099bd-d2f0-453f-a042-9b31c68c3b0f service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received event network-changed-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-60ef470d-e380-4409-bcb8-54f9e809e089 req-79c099bd-d2f0-453f-a042-9b31c68c3b0f service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Refreshing instance network info cache due to event network-changed-36f04c68-844f-43a3-956e-3a484a23b4c3. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60ef470d-e380-4409-bcb8-54f9e809e089 req-79c099bd-d2f0-453f-a042-9b31c68c3b0f service nova] Acquiring lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1e4702a1-9d80-496d-932b-24798e432c1e req-a0e6be62-4f75-4543-b719-2838b7aacbe4 service nova] Releasing lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updating instance_info_cache with network_info: [{"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Releasing lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Instance network_info: |[{"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60ef470d-e380-4409-bcb8-54f9e809e089 req-79c099bd-d2f0-453f-a042-9b31c68c3b0f service nova] Acquired lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-60ef470d-e380-4409-bcb8-54f9e809e089 req-79c099bd-d2f0-453f-a042-9b31c68c3b0f service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Refreshing network info cache for port 36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Start _get_guest_xml network_info=[{"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1035200767',display_name='tempest-VolumesAdminNegativeTest-server-1035200767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1035200767',id=7,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAT9AAsXFj5Sg8X0qNYEVaQMEzRsDfpY8RQeNr5EqpmMr2GZMVJ9jdJRVbtj6OcOXvgkc/UjHEOCSIPRS+oi1I33JT5GEEoe8IzzudbcALZBOIJj02TKZAgLFeSKVzkfw==',key_name='tempest-keypair-652508006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d820dd1ad9d42229c9537044fd32cbb',ramdisk_id='',reservation_id='r-7flupfw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1728786286',owner_user_name='tempest-VolumesAdminNegativeTest-1728786286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14b041e05644358b3365ca675a93cfe',uuid=0ab72540-6333-4a3b-bb5f-411e607bac1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converting VIF {"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:07,bridge_name='br-int',has_traffic_filtering=True,id=36f04c68-844f-43a3-956e-3a484a23b4c3,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04c68-84') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ab72540-6333-4a3b-bb5f-411e607bac1d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:38 user nova-compute[75288]:   <uuid>0ab72540-6333-4a3b-bb5f-411e607bac1d</uuid>
Dec 01 13:43:38 user nova-compute[75288]:   <name>instance-00000007</name>
Dec 01 13:43:38 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:38 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:38 user nova-compute[75288]:   <metadata>
Dec 01 13:43:38 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:38 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:38 user nova-compute[75288]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1035200767</nova:name>
Dec 01 13:43:38 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:38</nova:creationTime>
Dec 01 13:43:38 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:38 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:38 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:38 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:38 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:38 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:38 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:38 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:38 user nova-compute[75288]:         <nova:user uuid="b14b041e05644358b3365ca675a93cfe">tempest-VolumesAdminNegativeTest-1728786286-project-member</nova:user>
Dec 01 13:43:38 user nova-compute[75288]:         <nova:project uuid="2d820dd1ad9d42229c9537044fd32cbb">tempest-VolumesAdminNegativeTest-1728786286</nova:project>
Dec 01 13:43:38 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:38 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:43:38 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:38 user nova-compute[75288]:         <nova:port uuid="36f04c68-844f-43a3-956e-3a484a23b4c3">
Dec 01 13:43:38 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:43:38 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:38 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:38 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:38 user nova-compute[75288]:   </metadata>
Dec 01 13:43:38 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:38 user nova-compute[75288]:     <system>
Dec 01 13:43:38 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:38 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:38 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:38 user nova-compute[75288]:       <entry name="serial">0ab72540-6333-4a3b-bb5f-411e607bac1d</entry>
Dec 01 13:43:38 user nova-compute[75288]:       <entry name="uuid">0ab72540-6333-4a3b-bb5f-411e607bac1d</entry>
Dec 01 13:43:38 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:38 user nova-compute[75288]:     </system>
Dec 01 13:43:38 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:38 user nova-compute[75288]:   <os>
Dec 01 13:43:38 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:38 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:38 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:38 user nova-compute[75288]:   </os>
Dec 01 13:43:38 user nova-compute[75288]:   <features>
Dec 01 13:43:38 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:38 user nova-compute[75288]:     <apic/>
Dec 01 13:43:38 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:38 user nova-compute[75288]:   </features>
Dec 01 13:43:38 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:38 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:38 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:38 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:38 user nova-compute[75288]:   </clock>
Dec 01 13:43:38 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:38 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:38 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:38 user nova-compute[75288]:   </cpu>
Dec 01 13:43:38 user nova-compute[75288]:   <devices>
Dec 01 13:43:38 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:38 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:38 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk"/>
Dec 01 13:43:38 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:43:38 user nova-compute[75288]:     </disk>
Dec 01 13:43:38 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:38 user nova-compute[75288]:       <mac address="fa:16:3e:a8:95:07"/>
Dec 01 13:43:38 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:38 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:38 user nova-compute[75288]:       <target dev="tap36f04c68-84"/>
Dec 01 13:43:38 user nova-compute[75288]:     </interface>
Dec 01 13:43:38 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:38 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/console.log" append="off"/>
Dec 01 13:43:38 user nova-compute[75288]:     </serial>
Dec 01 13:43:38 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:38 user nova-compute[75288]:     <video>
Dec 01 13:43:38 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:38 user nova-compute[75288]:     </video>
Dec 01 13:43:38 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:38 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:38 user nova-compute[75288]:     </rng>
Dec 01 13:43:38 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:38 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:38 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:38 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:38 user nova-compute[75288]:   </devices>
Dec 01 13:43:38 user nova-compute[75288]: </domain>
Dec 01 13:43:38 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1035200767',display_name='tempest-VolumesAdminNegativeTest-server-1035200767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1035200767',id=7,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAT9AAsXFj5Sg8X0qNYEVaQMEzRsDfpY8RQeNr5EqpmMr2GZMVJ9jdJRVbtj6OcOXvgkc/UjHEOCSIPRS+oi1I33JT5GEEoe8IzzudbcALZBOIJj02TKZAgLFeSKVzkfw==',key_name='tempest-keypair-652508006',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d820dd1ad9d42229c9537044fd32cbb',ramdisk_id='',reservation_id='r-7flupfw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1728786286',owner_user_name='tempest-VolumesAdminNegativeTest-1728786286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14b041e05644358b3365ca675a93cfe',uuid=0ab72540-6333-4a3b-bb5f-411e607bac1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converting VIF {"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:07,bridge_name='br-int',has_traffic_filtering=True,id=36f04c68-844f-43a3-956e-3a484a23b4c3,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04c68-84') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG os_vif [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:07,bridge_name='br-int',has_traffic_filtering=True,id=36f04c68-844f-43a3-956e-3a484a23b4c3,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04c68-84') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8d8df3f-0448-5e3e-9db0-bfbddccf761b', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36f04c68-84, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36f04c68-84, col_values=(('qos', UUID('d3e42411-c341-4e56-a2b6-26e0cbd4f7a3')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36f04c68-84, col_values=(('external_ids', {'iface-id': '36f04c68-844f-43a3-956e-3a484a23b4c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:95:07', 'vm-uuid': '0ab72540-6333-4a3b-bb5f-411e607bac1d'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:38 user nova-compute[75288]: INFO os_vif [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:95:07,bridge_name='br-int',has_traffic_filtering=True,id=36f04c68-844f-43a3-956e-3a484a23b4c3,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04c68-84')
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] No VIF found with MAC fa:16:3e:a8:95:07, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-60ef470d-e380-4409-bcb8-54f9e809e089 req-79c099bd-d2f0-453f-a042-9b31c68c3b0f service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updated VIF entry in instance network info cache for port 36f04c68-844f-43a3-956e-3a484a23b4c3. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-60ef470d-e380-4409-bcb8-54f9e809e089 req-79c099bd-d2f0-453f-a042-9b31c68c3b0f service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updating instance_info_cache with network_info: [{"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60ef470d-e380-4409-bcb8-54f9e809e089 req-79c099bd-d2f0-453f-a042-9b31c68c3b0f service nova] Releasing lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received event network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] No waiting events found dispatching network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:40 user nova-compute[75288]: WARNING nova.compute.manager [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received unexpected event network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 for instance with vm_state building and task_state spawning.
Dec 01 13:43:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received event network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] No waiting events found dispatching network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:40 user nova-compute[75288]: WARNING nova.compute.manager [req-a8db14d6-7693-4f1e-a69d-97b28c7455de req-2cb4f0e4-96fb-4d9e-9986-eec729348532 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received unexpected event network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 for instance with vm_state building and task_state spawning.
Dec 01 13:43:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-c76fb4fa-cfa6-430a-97dd-90848024ca2d req-48f94eea-70ef-4a98-a4ad-cc29bdc4476b service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received event network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c76fb4fa-cfa6-430a-97dd-90848024ca2d req-48f94eea-70ef-4a98-a4ad-cc29bdc4476b service nova] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c76fb4fa-cfa6-430a-97dd-90848024ca2d req-48f94eea-70ef-4a98-a4ad-cc29bdc4476b service nova] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c76fb4fa-cfa6-430a-97dd-90848024ca2d req-48f94eea-70ef-4a98-a4ad-cc29bdc4476b service nova] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-c76fb4fa-cfa6-430a-97dd-90848024ca2d req-48f94eea-70ef-4a98-a4ad-cc29bdc4476b service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] No waiting events found dispatching network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:41 user nova-compute[75288]: WARNING nova.compute.manager [req-c76fb4fa-cfa6-430a-97dd-90848024ca2d req-48f94eea-70ef-4a98-a4ad-cc29bdc4476b service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received unexpected event network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 for instance with vm_state active and task_state None.
Dec 01 13:43:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:41 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:41 user nova-compute[75288]: INFO nova.compute.claims [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Claim successful on node user
Dec 01 13:43:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.737s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.296s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:43:42 user nova-compute[75288]: INFO nova.compute.claims [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Claim successful on node user
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:42 user nova-compute[75288]: DEBUG nova.policy [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71c1bf3a890049c1b32e227cfe787ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e036590e15c44735bce9998cadb23782', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Creating image(s)
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "/opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "/opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Instance spawned successfully.
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-1f4c0385-6014-4d03-8768-3cf073024c27 req-86cb572e-c569-4b61-9a4c-310aed7ba0c9 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received event network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1f4c0385-6014-4d03-8768-3cf073024c27 req-86cb572e-c569-4b61-9a4c-310aed7ba0c9 service nova] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1f4c0385-6014-4d03-8768-3cf073024c27 req-86cb572e-c569-4b61-9a4c-310aed7ba0c9 service nova] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1f4c0385-6014-4d03-8768-3cf073024c27 req-86cb572e-c569-4b61-9a4c-310aed7ba0c9 service nova] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-1f4c0385-6014-4d03-8768-3cf073024c27 req-86cb572e-c569-4b61-9a4c-310aed7ba0c9 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] No waiting events found dispatching network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:43 user nova-compute[75288]: WARNING nova.compute.manager [req-1f4c0385-6014-4d03-8768-3cf073024c27 req-86cb572e-c569-4b61-9a4c-310aed7ba0c9 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received unexpected event network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 for instance with vm_state active and task_state None.
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.115s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:43:43 user nova-compute[75288]: INFO nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Took 11.79 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee.part --force-share --output=json" returned: 0 in 0.322s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.virt.images [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] dd0a56c9-1627-4588-a44d-c9827de739f2 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee.part /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Successfully created port: 4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:43:43 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:43:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.policy [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5f09a6c46ad44f8bcb1ebbb07314ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d37ed5061104f40bbe5b7f54c9eff85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee.part /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee.converted" returned: 0 in 0.337s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:44 user nova-compute[75288]: INFO nova.compute.manager [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Took 14.47 seconds to build instance.
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-920f68cc-2b58-4dd4-8727-3f9898e98894 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.642s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:43:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Creating image(s)
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "/opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "/opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Instance spawned successfully.
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee.converted --force-share --output=json" returned: 0 in 0.481s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.727s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:44 user nova-compute[75288]: INFO nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Took 9.41 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.411s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee --force-share --output=json" returned: 0 in 0.463s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:45 user nova-compute[75288]: INFO nova.compute.manager [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Took 11.05 seconds to build instance.
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.445s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-33f087a8-81bc-4085-bbf9-1771bc574242 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.454s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Successfully updated port: 4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquired lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk 1073741824" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.642s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-91bfdcbf-c4fd-4785-b9c0-bb779714210f req-2283952a-2a87-40a1-a72a-bc0316ace12b service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received event network-changed-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-91bfdcbf-c4fd-4785-b9c0-bb779714210f req-2283952a-2a87-40a1-a72a-bc0316ace12b service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Refreshing instance network info cache due to event network-changed-4dda3cf3-235d-4f36-907d-7bf4620fb7a8. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91bfdcbf-c4fd-4785-b9c0-bb779714210f req-2283952a-2a87-40a1-a72a-bc0316ace12b service nova] Acquiring lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee --force-share --output=json" returned: 0 in 0.486s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee,backing_fmt=raw /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee,backing_fmt=raw /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk 1073741824" returned: 0 in 0.091s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.589s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Successfully created port: cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.356s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee --force-share --output=json" returned: 0 in 0.312s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json" returned: 0 in 0.411s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Cannot resize image /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Ensure instance console log exists: /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json" returned: 0 in 0.384s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Cannot resize image /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Ensure instance console log exists: /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Updating instance_info_cache with network_info: [{"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Releasing lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Instance network_info: |[{"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91bfdcbf-c4fd-4785-b9c0-bb779714210f req-2283952a-2a87-40a1-a72a-bc0316ace12b service nova] Acquired lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.network.neutron [req-91bfdcbf-c4fd-4785-b9c0-bb779714210f req-2283952a-2a87-40a1-a72a-bc0316ace12b service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Refreshing network info cache for port 4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Start _get_guest_xml network_info=[{"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:43:32Z,direct_url=<?>,disk_format='qcow2',id=dd0a56c9-1627-4588-a44d-c9827de739f2,min_disk=0,min_ram=0,name='',owner='4a5d98b17d4746df8ec4a955ae155c16',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'dd0a56c9-1627-4588-a44d-c9827de739f2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:43:32Z,direct_url=<?>,disk_format='qcow2',id=dd0a56c9-1627-4588-a44d-c9827de739f2,min_disk=0,min_ram=0,name='',owner='4a5d98b17d4746df8ec4a955ae155c16',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1253987832',display_name='tempest-AttachSCSIVolumeTestJSON-server-1253987832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1253987832',id=8,image_ref='dd0a56c9-1627-4588-a44d-c9827de739f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBMgMWEgyI3n91mzW9epitljo/ZCu+0e4GOhmW+TQkyvAgFzIRCM+X3EeYdBwRCsSgGWlHptA7X/gMgfA+NHFZeU48zknByUkTHtH/8dJi3lHymZ98eSV8j8O7uKHh+OA==',key_name='tempest-keypair-856239091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e036590e15c44735bce9998cadb23782',ramdisk_id='',reservation_id='r-3wdp0m6n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd0a56c9-1627-4588-a44d-c9827de739f2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1133164368',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1133164368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71c1bf3a890049c1b32e227cfe787ff0',uuid=b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Converting VIF {"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5d:db,bridge_name='br-int',has_traffic_filtering=True,id=4dda3cf3-235d-4f36-907d-7bf4620fb7a8,network=Network(d7834c39-6364-4d8d-9715-bc71fd825fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dda3cf3-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lazy-loading 'pci_devices' on Instance uuid b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:46 user nova-compute[75288]:   <uuid>b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf</uuid>
Dec 01 13:43:46 user nova-compute[75288]:   <name>instance-00000008</name>
Dec 01 13:43:46 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:46 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:46 user nova-compute[75288]:   <metadata>
Dec 01 13:43:46 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:46 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:46 user nova-compute[75288]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1253987832</nova:name>
Dec 01 13:43:46 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:46</nova:creationTime>
Dec 01 13:43:46 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:46 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:46 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:46 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:46 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:46 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:46 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:46 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:46 user nova-compute[75288]:         <nova:user uuid="71c1bf3a890049c1b32e227cfe787ff0">tempest-AttachSCSIVolumeTestJSON-1133164368-project-member</nova:user>
Dec 01 13:43:46 user nova-compute[75288]:         <nova:project uuid="e036590e15c44735bce9998cadb23782">tempest-AttachSCSIVolumeTestJSON-1133164368</nova:project>
Dec 01 13:43:46 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:46 user nova-compute[75288]:       <nova:root type="image" uuid="dd0a56c9-1627-4588-a44d-c9827de739f2"/>
Dec 01 13:43:46 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:46 user nova-compute[75288]:         <nova:port uuid="4dda3cf3-235d-4f36-907d-7bf4620fb7a8">
Dec 01 13:43:46 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 13:43:46 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:46 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:46 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:46 user nova-compute[75288]:   </metadata>
Dec 01 13:43:46 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:46 user nova-compute[75288]:     <system>
Dec 01 13:43:46 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:46 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:46 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:46 user nova-compute[75288]:       <entry name="serial">b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf</entry>
Dec 01 13:43:46 user nova-compute[75288]:       <entry name="uuid">b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf</entry>
Dec 01 13:43:46 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:46 user nova-compute[75288]:     </system>
Dec 01 13:43:46 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:46 user nova-compute[75288]:   <os>
Dec 01 13:43:46 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:46 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:46 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:46 user nova-compute[75288]:   </os>
Dec 01 13:43:46 user nova-compute[75288]:   <features>
Dec 01 13:43:46 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:46 user nova-compute[75288]:     <apic/>
Dec 01 13:43:46 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:46 user nova-compute[75288]:   </features>
Dec 01 13:43:46 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:46 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:46 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:46 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:46 user nova-compute[75288]:   </clock>
Dec 01 13:43:46 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:46 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:46 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:46 user nova-compute[75288]:   </cpu>
Dec 01 13:43:46 user nova-compute[75288]:   <devices>
Dec 01 13:43:46 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:46 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:46 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk"/>
Dec 01 13:43:46 user nova-compute[75288]:       <target dev="sda" bus="scsi"/>
Dec 01 13:43:46 user nova-compute[75288]:       <address type="drive" controller="0" unit="0"/>
Dec 01 13:43:46 user nova-compute[75288]:     </disk>
Dec 01 13:43:46 user nova-compute[75288]:     <disk type="file" device="cdrom">
Dec 01 13:43:46 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 13:43:46 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk.config"/>
Dec 01 13:43:46 user nova-compute[75288]:       <target dev="sdb" bus="scsi"/>
Dec 01 13:43:46 user nova-compute[75288]:       <address type="drive" controller="0" unit="1"/>
Dec 01 13:43:46 user nova-compute[75288]:     </disk>
Dec 01 13:43:46 user nova-compute[75288]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 01 13:43:46 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:46 user nova-compute[75288]:       <mac address="fa:16:3e:65:5d:db"/>
Dec 01 13:43:46 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:46 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:46 user nova-compute[75288]:       <target dev="tap4dda3cf3-23"/>
Dec 01 13:43:46 user nova-compute[75288]:     </interface>
Dec 01 13:43:46 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:46 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/console.log" append="off"/>
Dec 01 13:43:46 user nova-compute[75288]:     </serial>
Dec 01 13:43:46 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:46 user nova-compute[75288]:     <video>
Dec 01 13:43:46 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:46 user nova-compute[75288]:     </video>
Dec 01 13:43:46 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:46 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:46 user nova-compute[75288]:     </rng>
Dec 01 13:43:46 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:46 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:46 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:46 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:46 user nova-compute[75288]:   </devices>
Dec 01 13:43:46 user nova-compute[75288]: </domain>
Dec 01 13:43:46 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1253987832',display_name='tempest-AttachSCSIVolumeTestJSON-server-1253987832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1253987832',id=8,image_ref='dd0a56c9-1627-4588-a44d-c9827de739f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBMgMWEgyI3n91mzW9epitljo/ZCu+0e4GOhmW+TQkyvAgFzIRCM+X3EeYdBwRCsSgGWlHptA7X/gMgfA+NHFZeU48zknByUkTHtH/8dJi3lHymZ98eSV8j8O7uKHh+OA==',key_name='tempest-keypair-856239091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e036590e15c44735bce9998cadb23782',ramdisk_id='',reservation_id='r-3wdp0m6n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd0a56c9-1627-4588-a44d-c9827de739f2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1133164368',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1133164368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71c1bf3a890049c1b32e227cfe787ff0',uuid=b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Converting VIF {"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5d:db,bridge_name='br-int',has_traffic_filtering=True,id=4dda3cf3-235d-4f36-907d-7bf4620fb7a8,network=Network(d7834c39-6364-4d8d-9715-bc71fd825fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dda3cf3-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG os_vif [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5d:db,bridge_name='br-int',has_traffic_filtering=True,id=4dda3cf3-235d-4f36-907d-7bf4620fb7a8,network=Network(d7834c39-6364-4d8d-9715-bc71fd825fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dda3cf3-23') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ef70e3e-9bc8-5470-9a80-e33dfe3f3f35', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dda3cf3-23, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dda3cf3-23, col_values=(('qos', UUID('3da1ca4f-bbe9-45b7-8f8a-13d71b4529d8')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dda3cf3-23, col_values=(('external_ids', {'iface-id': '4dda3cf3-235d-4f36-907d-7bf4620fb7a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:5d:db', 'vm-uuid': 'b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:47 user nova-compute[75288]: INFO os_vif [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5d:db,bridge_name='br-int',has_traffic_filtering=True,id=4dda3cf3-235d-4f36-907d-7bf4620fb7a8,network=Network(d7834c39-6364-4d8d-9715-bc71fd825fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dda3cf3-23')
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] No BDM found with device name sda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] No VIF found with MAC fa:16:3e:65:5d:db, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Using config drive
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Successfully updated port: cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquired lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-de35ab09-ee33-419f-b2c8-c6b00353acf4 req-0b65bcbf-42db-4fea-a446-93285ad9654c service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received event network-changed-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-de35ab09-ee33-419f-b2c8-c6b00353acf4 req-0b65bcbf-42db-4fea-a446-93285ad9654c service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Refreshing instance network info cache due to event network-changed-cf3a6053-9edf-4e08-9a42-b4227eae8e1b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de35ab09-ee33-419f-b2c8-c6b00353acf4 req-0b65bcbf-42db-4fea-a446-93285ad9654c service nova] Acquiring lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-91bfdcbf-c4fd-4785-b9c0-bb779714210f req-2283952a-2a87-40a1-a72a-bc0316ace12b service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Updated VIF entry in instance network info cache for port 4dda3cf3-235d-4f36-907d-7bf4620fb7a8. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-91bfdcbf-c4fd-4785-b9c0-bb779714210f req-2283952a-2a87-40a1-a72a-bc0316ace12b service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Updating instance_info_cache with network_info: [{"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-91bfdcbf-c4fd-4785-b9c0-bb779714210f req-2283952a-2a87-40a1-a72a-bc0316ace12b service nova] Releasing lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:43:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Creating config drive at /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk.config
Dec 01 13:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpv4qufmpe {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Updating instance_info_cache with network_info: [{"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpv4qufmpe" returned: 0 in 0.085s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Releasing lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Instance network_info: |[{"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de35ab09-ee33-419f-b2c8-c6b00353acf4 req-0b65bcbf-42db-4fea-a446-93285ad9654c service nova] Acquired lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-de35ab09-ee33-419f-b2c8-c6b00353acf4 req-0b65bcbf-42db-4fea-a446-93285ad9654c service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Refreshing network info cache for port cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Start _get_guest_xml network_info=[{"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:43:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1422221354',display_name='tempest-VolumesAssistedSnapshotsTest-server-1422221354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1422221354',id=9,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6jrx21bYaRECPGAxE38STS2d/ztvEIqK7shIZXBtBETQqCoijonjEPv31xBg5Anukl5OzeWpTkQOeK7fiVWZUEfkyfqfRXAdWPxghAnM+RfAajqRgANdKGkLuPH/lGEA==',key_name='tempest-keypair-2136318084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d37ed5061104f40bbe5b7f54c9eff85',ramdisk_id='',reservation_id='r-62dgvvnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-118519178',owner_user_name='tempest-VolumesAssistedSnapshotsTest-118519178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5f09a6c46ad44f8bcb1ebbb07314ba1',uuid=c1ede7e1-e693-455e-ade4-8c1a02418ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Converting VIF {"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:83:37,bridge_name='br-int',has_traffic_filtering=True,id=cf3a6053-9edf-4e08-9a42-b4227eae8e1b,network=Network(408df822-8582-466a-8c70-5681013da590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a6053-9e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lazy-loading 'pci_devices' on Instance uuid c1ede7e1-e693-455e-ade4-8c1a02418ae0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:43:48 user nova-compute[75288]:   <uuid>c1ede7e1-e693-455e-ade4-8c1a02418ae0</uuid>
Dec 01 13:43:48 user nova-compute[75288]:   <name>instance-00000009</name>
Dec 01 13:43:48 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:43:48 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:43:48 user nova-compute[75288]:   <metadata>
Dec 01 13:43:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:43:48 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:43:48 user nova-compute[75288]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1422221354</nova:name>
Dec 01 13:43:48 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:43:48</nova:creationTime>
Dec 01 13:43:48 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:43:48 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:43:48 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:43:48 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:43:48 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:43:48 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:43:48 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:43:48 user nova-compute[75288]:       <nova:owner>
Dec 01 13:43:48 user nova-compute[75288]:         <nova:user uuid="e5f09a6c46ad44f8bcb1ebbb07314ba1">tempest-VolumesAssistedSnapshotsTest-118519178-project-member</nova:user>
Dec 01 13:43:48 user nova-compute[75288]:         <nova:project uuid="2d37ed5061104f40bbe5b7f54c9eff85">tempest-VolumesAssistedSnapshotsTest-118519178</nova:project>
Dec 01 13:43:48 user nova-compute[75288]:       </nova:owner>
Dec 01 13:43:48 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:43:48 user nova-compute[75288]:       <nova:ports>
Dec 01 13:43:48 user nova-compute[75288]:         <nova:port uuid="cf3a6053-9edf-4e08-9a42-b4227eae8e1b">
Dec 01 13:43:48 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:43:48 user nova-compute[75288]:         </nova:port>
Dec 01 13:43:48 user nova-compute[75288]:       </nova:ports>
Dec 01 13:43:48 user nova-compute[75288]:     </nova:instance>
Dec 01 13:43:48 user nova-compute[75288]:   </metadata>
Dec 01 13:43:48 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:43:48 user nova-compute[75288]:     <system>
Dec 01 13:43:48 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:43:48 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:43:48 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:43:48 user nova-compute[75288]:       <entry name="serial">c1ede7e1-e693-455e-ade4-8c1a02418ae0</entry>
Dec 01 13:43:48 user nova-compute[75288]:       <entry name="uuid">c1ede7e1-e693-455e-ade4-8c1a02418ae0</entry>
Dec 01 13:43:48 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:43:48 user nova-compute[75288]:     </system>
Dec 01 13:43:48 user nova-compute[75288]:   </sysinfo>
Dec 01 13:43:48 user nova-compute[75288]:   <os>
Dec 01 13:43:48 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:43:48 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:43:48 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:43:48 user nova-compute[75288]:   </os>
Dec 01 13:43:48 user nova-compute[75288]:   <features>
Dec 01 13:43:48 user nova-compute[75288]:     <acpi/>
Dec 01 13:43:48 user nova-compute[75288]:     <apic/>
Dec 01 13:43:48 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:43:48 user nova-compute[75288]:   </features>
Dec 01 13:43:48 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:43:48 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:43:48 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:43:48 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:43:48 user nova-compute[75288]:   </clock>
Dec 01 13:43:48 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:43:48 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:43:48 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:43:48 user nova-compute[75288]:   </cpu>
Dec 01 13:43:48 user nova-compute[75288]:   <devices>
Dec 01 13:43:48 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:43:48 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:43:48 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk"/>
Dec 01 13:43:48 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:43:48 user nova-compute[75288]:     </disk>
Dec 01 13:43:48 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:43:48 user nova-compute[75288]:       <mac address="fa:16:3e:0e:83:37"/>
Dec 01 13:43:48 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:48 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:43:48 user nova-compute[75288]:       <target dev="tapcf3a6053-9e"/>
Dec 01 13:43:48 user nova-compute[75288]:     </interface>
Dec 01 13:43:48 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:43:48 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/console.log" append="off"/>
Dec 01 13:43:48 user nova-compute[75288]:     </serial>
Dec 01 13:43:48 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:43:48 user nova-compute[75288]:     <video>
Dec 01 13:43:48 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:43:48 user nova-compute[75288]:     </video>
Dec 01 13:43:48 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:43:48 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:43:48 user nova-compute[75288]:     </rng>
Dec 01 13:43:48 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:43:48 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:43:48 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:43:48 user nova-compute[75288]:     </memballoon>
Dec 01 13:43:48 user nova-compute[75288]:   </devices>
Dec 01 13:43:48 user nova-compute[75288]: </domain>
Dec 01 13:43:48 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1422221354',display_name='tempest-VolumesAssistedSnapshotsTest-server-1422221354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1422221354',id=9,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6jrx21bYaRECPGAxE38STS2d/ztvEIqK7shIZXBtBETQqCoijonjEPv31xBg5Anukl5OzeWpTkQOeK7fiVWZUEfkyfqfRXAdWPxghAnM+RfAajqRgANdKGkLuPH/lGEA==',key_name='tempest-keypair-2136318084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d37ed5061104f40bbe5b7f54c9eff85',ramdisk_id='',reservation_id='r-62dgvvnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-118519178',owner_user_name='tempest-VolumesAssistedSnapshotsTest-118519178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5f09a6c46ad44f8bcb1ebbb07314ba1',uuid=c1ede7e1-e693-455e-ade4-8c1a02418ae0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Converting VIF {"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:83:37,bridge_name='br-int',has_traffic_filtering=True,id=cf3a6053-9edf-4e08-9a42-b4227eae8e1b,network=Network(408df822-8582-466a-8c70-5681013da590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a6053-9e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG os_vif [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:83:37,bridge_name='br-int',has_traffic_filtering=True,id=cf3a6053-9edf-4e08-9a42-b4227eae8e1b,network=Network(408df822-8582-466a-8c70-5681013da590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a6053-9e') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fcddb24c-db1e-55ac-abea-0fa88e07c7ac', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf3a6053-9e, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf3a6053-9e, col_values=(('qos', UUID('0196a9f5-c276-4b8e-9309-1e70259fb8f4')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf3a6053-9e, col_values=(('external_ids', {'iface-id': 'cf3a6053-9edf-4e08-9a42-b4227eae8e1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:83:37', 'vm-uuid': 'c1ede7e1-e693-455e-ade4-8c1a02418ae0'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:48 user nova-compute[75288]: INFO os_vif [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:83:37,bridge_name='br-int',has_traffic_filtering=True,id=cf3a6053-9edf-4e08-9a42-b4227eae8e1b,network=Network(408df822-8582-466a-8c70-5681013da590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a6053-9e')
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:43:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] No VIF found with MAC fa:16:3e:0e:83:37, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-de35ab09-ee33-419f-b2c8-c6b00353acf4 req-0b65bcbf-42db-4fea-a446-93285ad9654c service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Updated VIF entry in instance network info cache for port cf3a6053-9edf-4e08-9a42-b4227eae8e1b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-de35ab09-ee33-419f-b2c8-c6b00353acf4 req-0b65bcbf-42db-4fea-a446-93285ad9654c service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Updating instance_info_cache with network_info: [{"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de35ab09-ee33-419f-b2c8-c6b00353acf4 req-0b65bcbf-42db-4fea-a446-93285ad9654c service nova] Releasing lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received event network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] No waiting events found dispatching network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:49 user nova-compute[75288]: WARNING nova.compute.manager [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received unexpected event network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 for instance with vm_state active and task_state None.
Dec 01 13:43:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received event network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] No waiting events found dispatching network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:49 user nova-compute[75288]: WARNING nova.compute.manager [req-d1ff00a0-9482-4b57-b48f-0fb5e4a4fa14 req-23a0a07e-4711-46ff-9875-18bef05d541a service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received unexpected event network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 for instance with vm_state active and task_state None.
Dec 01 13:43:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-28d45c5f-62f8-45b5-9ab9-43db11baf657 req-ca4a47d1-d0c7-44eb-891c-e7679f128507 service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received event network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28d45c5f-62f8-45b5-9ab9-43db11baf657 req-ca4a47d1-d0c7-44eb-891c-e7679f128507 service nova] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28d45c5f-62f8-45b5-9ab9-43db11baf657 req-ca4a47d1-d0c7-44eb-891c-e7679f128507 service nova] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28d45c5f-62f8-45b5-9ab9-43db11baf657 req-ca4a47d1-d0c7-44eb-891c-e7679f128507 service nova] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-28d45c5f-62f8-45b5-9ab9-43db11baf657 req-ca4a47d1-d0c7-44eb-891c-e7679f128507 service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] No waiting events found dispatching network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:51 user nova-compute[75288]: WARNING nova.compute.manager [req-28d45c5f-62f8-45b5-9ab9-43db11baf657 req-ca4a47d1-d0c7-44eb-891c-e7679f128507 service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received unexpected event network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b for instance with vm_state building and task_state spawning.
Dec 01 13:43:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-b46d5b5c-2cd2-4604-9d9e-66a14ad455e7 req-add59319-1f64-4ffe-8eb4-14bc9c7ff21e service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received event network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b46d5b5c-2cd2-4604-9d9e-66a14ad455e7 req-add59319-1f64-4ffe-8eb4-14bc9c7ff21e service nova] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b46d5b5c-2cd2-4604-9d9e-66a14ad455e7 req-add59319-1f64-4ffe-8eb4-14bc9c7ff21e service nova] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b46d5b5c-2cd2-4604-9d9e-66a14ad455e7 req-add59319-1f64-4ffe-8eb4-14bc9c7ff21e service nova] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-b46d5b5c-2cd2-4604-9d9e-66a14ad455e7 req-add59319-1f64-4ffe-8eb4-14bc9c7ff21e service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] No waiting events found dispatching network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:43:53 user nova-compute[75288]: WARNING nova.compute.manager [req-b46d5b5c-2cd2-4604-9d9e-66a14ad455e7 req-add59319-1f64-4ffe-8eb4-14bc9c7ff21e service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received unexpected event network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b for instance with vm_state building and task_state spawning.
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Instance spawned successfully.
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:43:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Instance spawned successfully.
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:43:54 user nova-compute[75288]: INFO nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Took 11.38 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:43:54 user nova-compute[75288]: INFO nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Took 9.95 seconds to spawn the instance on the hypervisor.
Dec 01 13:43:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:43:54 user nova-compute[75288]: INFO nova.compute.manager [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Took 12.65 seconds to build instance.
Dec 01 13:43:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6b6a5e9b-bd69-4ad6-918f-9e1ae611a5b6 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.846s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:54 user nova-compute[75288]: INFO nova.compute.manager [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Took 12.28 seconds to build instance.
Dec 01 13:43:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d919d42d-6ec0-4621-adb7-0e8026f5c1ca tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.511s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:43:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 13:43:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 0 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 13:43:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 13:43:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:43:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:43:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:05 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:44:05 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:44:05 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7541MB free_disk=25.63372802734375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2c66ff7f-d0d9-43ff-98a4-bb702780e080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d6528740-f062-4dd6-9b99-d41042e2abe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0ab72540-6333-4a3b-bb5f-411e607bac1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing inventories for resource provider 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating ProviderTree inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing aggregate associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing trait associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:44:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.978s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:44:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 03de2627-2167-48c9-94cb-bd57c18f87c8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:44:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8c4d94c-0c37-468d-bde6-24240e89caa6 req-a3bcc527-38da-4a5c-8a88-1fdc60369468 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8c4d94c-0c37-468d-bde6-24240e89caa6 req-a3bcc527-38da-4a5c-8a88-1fdc60369468 service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8c4d94c-0c37-468d-bde6-24240e89caa6 req-a3bcc527-38da-4a5c-8a88-1fdc60369468 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f8c4d94c-0c37-468d-bde6-24240e89caa6 req-a3bcc527-38da-4a5c-8a88-1fdc60369468 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-f8c4d94c-0c37-468d-bde6-24240e89caa6 req-a3bcc527-38da-4a5c-8a88-1fdc60369468 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:44:13 user nova-compute[75288]: WARNING nova.compute.manager [req-f8c4d94c-0c37-468d-bde6-24240e89caa6 req-a3bcc527-38da-4a5c-8a88-1fdc60369468 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state active and task_state None.
Dec 01 13:44:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:44:15 user nova-compute[75288]: WARNING nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state active and task_state None.
Dec 01 13:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received event network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] No waiting events found dispatching network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:44:15 user nova-compute[75288]: WARNING nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received unexpected event network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 for instance with vm_state active and task_state None.
Dec 01 13:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received event network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] No waiting events found dispatching network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:44:15 user nova-compute[75288]: WARNING nova.compute.manager [req-f58554fd-0eae-4213-811e-e02f200cb075 req-7e7df619-1ec2-429b-a9a0-6b2cf787fdd5 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received unexpected event network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 for instance with vm_state active and task_state None.
Dec 01 13:44:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:44:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "b2803270-b513-474d-8607-619f8582d6a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "b2803270-b513-474d-8607-619f8582d6a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:44:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:44:38 user nova-compute[75288]: INFO nova.compute.claims [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Claim successful on node user
Dec 01 13:44:39 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:44:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:44:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:44:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:44:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:44:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:44:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:44:39 user nova-compute[75288]: DEBUG nova.policy [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab6a9e09550e42edac3c1e8a9112fbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1120cc4cc3d8458aaf5755a500e994c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:44:39 user nova-compute[75288]: INFO nova.virt.block_device [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Booting with volume snapshot ba5c5e68-422c-4c34-aeea-02d1fcd70d3b at /dev/vda
Dec 01 13:44:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Successfully created port: 66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Successfully updated port: 66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "refresh_cache-b2803270-b513-474d-8607-619f8582d6a0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquired lock "refresh_cache-b2803270-b513-474d-8607-619f8582d6a0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b4aaa59-1b65-4904-89aa-22e34a9db58b req-c9a14eb7-9367-48e4-8d84-695c3dcb1567 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received event network-changed-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b4aaa59-1b65-4904-89aa-22e34a9db58b req-c9a14eb7-9367-48e4-8d84-695c3dcb1567 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Refreshing instance network info cache due to event network-changed-66cd67d7-779c-4a70-925b-baf5f49bbf20. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b4aaa59-1b65-4904-89aa-22e34a9db58b req-c9a14eb7-9367-48e4-8d84-695c3dcb1567 service nova] Acquiring lock "refresh_cache-b2803270-b513-474d-8607-619f8582d6a0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Updating instance_info_cache with network_info: [{"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Releasing lock "refresh_cache-b2803270-b513-474d-8607-619f8582d6a0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Instance network_info: |[{"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b4aaa59-1b65-4904-89aa-22e34a9db58b req-c9a14eb7-9367-48e4-8d84-695c3dcb1567 service nova] Acquired lock "refresh_cache-b2803270-b513-474d-8607-619f8582d6a0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-8b4aaa59-1b65-4904-89aa-22e34a9db58b req-c9a14eb7-9367-48e4-8d84-695c3dcb1567 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Refreshing network info cache for port 66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-8b4aaa59-1b65-4904-89aa-22e34a9db58b req-c9a14eb7-9367-48e4-8d84-695c3dcb1567 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Updated VIF entry in instance network info cache for port 66cd67d7-779c-4a70-925b-baf5f49bbf20. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:44:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-8b4aaa59-1b65-4904-89aa-22e34a9db58b req-c9a14eb7-9367-48e4-8d84-695c3dcb1567 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Updating instance_info_cache with network_info: [{"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b4aaa59-1b65-4904-89aa-22e34a9db58b req-c9a14eb7-9367-48e4-8d84-695c3dcb1567 service nova] Releasing lock "refresh_cache-b2803270-b513-474d-8607-619f8582d6a0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:44:42 user nova-compute[75288]: INFO nova.compute.claims [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Claim successful on node user
Dec 01 13:44:42 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:44:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:44:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:44:42 user nova-compute[75288]: DEBUG nova.policy [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18550a125f0a418c9d9c4565e26f5358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc0d4c7e27d4241be2c3ea05267de7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:44:42 user nova-compute[75288]: INFO nova.virt.block_device [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Booting with volume f962286e-7129-4755-9a1d-4c9c67bd3f53 at /dev/vda
Dec 01 13:44:43 user nova-compute[75288]: DEBUG os_brick.utils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:44:43 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpth903mtz/privsep.sock']
Dec 01 13:44:43 user sudo[86461]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpth903mtz/privsep.sock
Dec 01 13:44:43 user sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 13:44:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:43 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully created port: 4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:44 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully created port: 689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:44 user sudo[86461]: pam_unix(sudo:session): session closed for user root
Dec 01 13:44:44 user nova-compute[75288]: INFO oslo.privsep.daemon [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Spawned new privsep daemon via rootwrap
Dec 01 13:44:44 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 13:44:44 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 13:44:44 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 01 13:44:44 user nova-compute[75288]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86480
Dec 01 13:44:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8d0fa3-8a66-4dcb-9d6b-4726c0cd0312]: (2,) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ff4f0-875e-48f4-b3ef-10e811f713f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: WARNING os_brick.initiator.connectors.nvmeof [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[607d9151-7b74-4395-9e50-89d77e2bb663]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2ab79-cbfd-4313-834e-a595c6d56708]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[503dafea-2136-427f-8ce1-d6a290981816]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully created port: 5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:44:45 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cdc085-13d9-494e-8615-c4b7a73e0741]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.utils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== get_connector_properties: return (2164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating existing volume attachment record: 89998a62-d7fd-40e9-92aa-5bd464a560ef {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.utils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7547016-e6f9-4e78-95fd-6bee0e8b1076]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56a4a8e-e9a6-4ad0-919b-6386b062c543]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9539842-6f23-4ca8-82de-a6cb2064c82a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[722b159e-aa35-4a92-a3aa-790b3ab3ca0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:44:45 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:44:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0626c3-805b-424d-b1cb-1e6084e1030c]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG os_brick.utils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Updating existing volume attachment record: 26a669c9-7ab2-4b5d-8eca-f6ad48804ed6 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:44:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully created port: 63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully created port: eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully updated port: 4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-264ec2b2-0513-4f43-9719-233ac83865f5 req-fd6f49bd-d616-4d09-8d97-19361bf9260f service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-changed-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-264ec2b2-0513-4f43-9719-233ac83865f5 req-fd6f49bd-d616-4d09-8d97-19361bf9260f service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing instance network info cache due to event network-changed-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-264ec2b2-0513-4f43-9719-233ac83865f5 req-fd6f49bd-d616-4d09-8d97-19361bf9260f service nova] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-264ec2b2-0513-4f43-9719-233ac83865f5 req-fd6f49bd-d616-4d09-8d97-19361bf9260f service nova] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-264ec2b2-0513-4f43-9719-233ac83865f5 req-fd6f49bd-d616-4d09-8d97-19361bf9260f service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing network info cache for port 4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-264ec2b2-0513-4f43-9719-233ac83865f5 req-fd6f49bd-d616-4d09-8d97-19361bf9260f service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-264ec2b2-0513-4f43-9719-233ac83865f5 req-fd6f49bd-d616-4d09-8d97-19361bf9260f service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-264ec2b2-0513-4f43-9719-233ac83865f5 req-fd6f49bd-d616-4d09-8d97-19361bf9260f service nova] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully updated port: c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:44:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully updated port: 22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully updated port: 689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-changed-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing instance network info cache due to event network-changed-c8144593-0826-4a56-bcb1-0eb7faa68f3a. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing network info cache for port c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-changed-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing instance network info cache due to event network-changed-22ecad86-3a29-4f33-88d9-10a4b10569f5. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing network info cache for port 22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd999393-b52a-4a5c-bbcd-15832fe4755a req-3dfa7933-5f04-48e1-83d5-f2635b6d1ed8 service nova] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:50 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully updated port: 5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully updated port: 63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-changed-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing instance network info cache due to event network-changed-689e9e88-11d4-4fdb-9762-ee44d52fe74d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing network info cache for port 689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-changed-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing instance network info cache due to event network-changed-5c91590c-ef72-4c8e-8b32-405d39bbed6f. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing network info cache for port 5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:51 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Successfully updated port: eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-changed-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing instance network info cache due to event network-changed-63109067-3882-4582-85c2-b0e33c24ce6f. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing network info cache for port 63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.network.neutron [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30634e08-5fa1-49d9-b87a-428cc50e8b73 req-96b7848d-f5ae-4f9f-b34b-118a60ee505c service nova] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "95dfd223-db19-40c4-ac65-fcba4100e247" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "95dfd223-db19-40c4-ac65-fcba4100e247" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:44:52 user nova-compute[75288]: INFO nova.compute.claims [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Claim successful on node user
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:44:52 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:44:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:44:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Creating image(s)
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "/opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "/opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "/opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.policy [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb674e9bacc47eba54fc0e028ed1c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fc75c95ba9494ca2b5aca352bf916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-968e0159-9544-4435-a697-581712e3e82b req-33ac999c-2273-40ad-9cb9-2808f8bb31af service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-changed-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-968e0159-9544-4435-a697-581712e3e82b req-33ac999c-2273-40ad-9cb9-2808f8bb31af service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing instance network info cache due to event network-changed-eea6e247-33fe-41c7-82d5-58ffbf9187fc. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-968e0159-9544-4435-a697-581712e3e82b req-33ac999c-2273-40ad-9cb9-2808f8bb31af service nova] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk 1073741824" returned: 0 in 0.050s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Cannot resize image /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Ensure instance console log exists: /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:44:54 user nova-compute[75288]: INFO nova.compute.claims [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Claim successful on node user
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:44:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Successfully created port: b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:54 user nova-compute[75288]: INFO nova.virt.block_device [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Booting with volume 40010598-b7e8-4a05-bcaa-6291feb5fe21 at /dev/vda
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.policy [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb0b77c33fae4ec6904a365da24cff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bdefcd6dad4213a733b8ba90eb0c61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG os_brick.utils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bfbd15-9057-463a-8820-9722c3d57137]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10d8dc2-0905-4454-b076-6d7a7899ae6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[223a221e-fc73-4cec-abcf-5967131ab35b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2299fd-db6d-4138-b113-39c67578592b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:44:54 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:44:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6210b1cd-1d33-4f5b-a96f-e77718e158ed]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG os_brick.utils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:44:54 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating existing volume attachment record: 2c85b9b0-603d-44c1-bb01-b05579b1f2d3 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [{"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance network_info: |[{"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-968e0159-9544-4435-a697-581712e3e82b req-33ac999c-2273-40ad-9cb9-2808f8bb31af service nova] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-968e0159-9544-4435-a697-581712e3e82b req-33ac999c-2273-40ad-9cb9-2808f8bb31af service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing network info cache for port eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully created port: 47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Successfully updated port: b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "refresh_cache-95dfd223-db19-40c4-ac65-fcba4100e247" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquired lock "refresh_cache-95dfd223-db19-40c4-ac65-fcba4100e247" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-968e0159-9544-4435-a697-581712e3e82b req-33ac999c-2273-40ad-9cb9-2808f8bb31af service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updated VIF entry in instance network info cache for port eea6e247-33fe-41c7-82d5-58ffbf9187fc. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-968e0159-9544-4435-a697-581712e3e82b req-33ac999c-2273-40ad-9cb9-2808f8bb31af service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [{"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-953419dc-ce41-44bc-9c00-eb3030b779ca req-c60feffb-7bfb-4341-971f-4d9edb84c1ac service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received event network-changed-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-953419dc-ce41-44bc-9c00-eb3030b779ca req-c60feffb-7bfb-4341-971f-4d9edb84c1ac service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Refreshing instance network info cache due to event network-changed-b7ff400a-19a7-4da8-88e4-7c41d83690dc. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-953419dc-ce41-44bc-9c00-eb3030b779ca req-c60feffb-7bfb-4341-971f-4d9edb84c1ac service nova] Acquiring lock "refresh_cache-95dfd223-db19-40c4-ac65-fcba4100e247" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-968e0159-9544-4435-a697-581712e3e82b req-33ac999c-2273-40ad-9cb9-2808f8bb31af service nova] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully created port: 35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Updating instance_info_cache with network_info: [{"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Releasing lock "refresh_cache-95dfd223-db19-40c4-ac65-fcba4100e247" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Instance network_info: |[{"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-953419dc-ce41-44bc-9c00-eb3030b779ca req-c60feffb-7bfb-4341-971f-4d9edb84c1ac service nova] Acquired lock "refresh_cache-95dfd223-db19-40c4-ac65-fcba4100e247" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-953419dc-ce41-44bc-9c00-eb3030b779ca req-c60feffb-7bfb-4341-971f-4d9edb84c1ac service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Refreshing network info cache for port b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Start _get_guest_xml network_info=[{"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:44:56 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:44:56 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-454613805',display_name='tempest-VolumesNegativeTest-instance-454613805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-454613805',id=12,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2fc75c95ba9494ca2b5aca352bf916b',ramdisk_id='',reservation_id='r-v80c72ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-521133940',owner_user_name='tempest-VolumesNegativeTest-521133940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:53Z,user_data=None,user_id='cfb674e9bacc47eba54fc0e028ed1c77',uuid=95dfd223-db19-40c4-ac65-fcba4100e247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Converting VIF {"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:36:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7ff400a-19a7-4da8-88e4-7c41d83690dc,network=Network(dbd18687-1e59-4379-a7d3-ccddadafebd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ff400a-19') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lazy-loading 'pci_devices' on Instance uuid 95dfd223-db19-40c4-ac65-fcba4100e247 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:44:56 user nova-compute[75288]:   <uuid>95dfd223-db19-40c4-ac65-fcba4100e247</uuid>
Dec 01 13:44:56 user nova-compute[75288]:   <name>instance-0000000c</name>
Dec 01 13:44:56 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:44:56 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:44:56 user nova-compute[75288]:   <metadata>
Dec 01 13:44:56 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:44:56 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:44:56 user nova-compute[75288]:       <nova:name>tempest-VolumesNegativeTest-instance-454613805</nova:name>
Dec 01 13:44:56 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:44:56</nova:creationTime>
Dec 01 13:44:56 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:44:56 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:44:56 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:44:56 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:44:56 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:44:56 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:44:56 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:44:56 user nova-compute[75288]:       <nova:owner>
Dec 01 13:44:56 user nova-compute[75288]:         <nova:user uuid="cfb674e9bacc47eba54fc0e028ed1c77">tempest-VolumesNegativeTest-521133940-project-member</nova:user>
Dec 01 13:44:56 user nova-compute[75288]:         <nova:project uuid="b2fc75c95ba9494ca2b5aca352bf916b">tempest-VolumesNegativeTest-521133940</nova:project>
Dec 01 13:44:56 user nova-compute[75288]:       </nova:owner>
Dec 01 13:44:56 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:44:56 user nova-compute[75288]:       <nova:ports>
Dec 01 13:44:56 user nova-compute[75288]:         <nova:port uuid="b7ff400a-19a7-4da8-88e4-7c41d83690dc">
Dec 01 13:44:56 user nova-compute[75288]:           <nova:ip type="fixed" address="192.168.233.166" ipVersion="4"/>
Dec 01 13:44:56 user nova-compute[75288]:         </nova:port>
Dec 01 13:44:56 user nova-compute[75288]:       </nova:ports>
Dec 01 13:44:56 user nova-compute[75288]:     </nova:instance>
Dec 01 13:44:56 user nova-compute[75288]:   </metadata>
Dec 01 13:44:56 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:44:56 user nova-compute[75288]:     <system>
Dec 01 13:44:56 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:44:56 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:44:56 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:44:56 user nova-compute[75288]:       <entry name="serial">95dfd223-db19-40c4-ac65-fcba4100e247</entry>
Dec 01 13:44:56 user nova-compute[75288]:       <entry name="uuid">95dfd223-db19-40c4-ac65-fcba4100e247</entry>
Dec 01 13:44:56 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:44:56 user nova-compute[75288]:     </system>
Dec 01 13:44:56 user nova-compute[75288]:   </sysinfo>
Dec 01 13:44:56 user nova-compute[75288]:   <os>
Dec 01 13:44:56 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:44:56 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:44:56 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:44:56 user nova-compute[75288]:   </os>
Dec 01 13:44:56 user nova-compute[75288]:   <features>
Dec 01 13:44:56 user nova-compute[75288]:     <acpi/>
Dec 01 13:44:56 user nova-compute[75288]:     <apic/>
Dec 01 13:44:56 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:44:56 user nova-compute[75288]:   </features>
Dec 01 13:44:56 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:44:56 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:44:56 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:44:56 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:44:56 user nova-compute[75288]:   </clock>
Dec 01 13:44:56 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:44:56 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:44:56 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:44:56 user nova-compute[75288]:   </cpu>
Dec 01 13:44:56 user nova-compute[75288]:   <devices>
Dec 01 13:44:56 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:44:56 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:44:56 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk"/>
Dec 01 13:44:56 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:44:56 user nova-compute[75288]:     </disk>
Dec 01 13:44:56 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:44:56 user nova-compute[75288]:       <mac address="fa:16:3e:2e:36:1a"/>
Dec 01 13:44:56 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:44:56 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:44:56 user nova-compute[75288]:       <target dev="tapb7ff400a-19"/>
Dec 01 13:44:56 user nova-compute[75288]:     </interface>
Dec 01 13:44:56 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:44:56 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/console.log" append="off"/>
Dec 01 13:44:56 user nova-compute[75288]:     </serial>
Dec 01 13:44:56 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:44:56 user nova-compute[75288]:     <video>
Dec 01 13:44:56 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:44:56 user nova-compute[75288]:     </video>
Dec 01 13:44:56 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:44:56 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:44:56 user nova-compute[75288]:     </rng>
Dec 01 13:44:56 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:44:56 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:44:56 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:44:56 user nova-compute[75288]:     </memballoon>
Dec 01 13:44:56 user nova-compute[75288]:   </devices>
Dec 01 13:44:56 user nova-compute[75288]: </domain>
Dec 01 13:44:56 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-454613805',display_name='tempest-VolumesNegativeTest-instance-454613805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-454613805',id=12,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2fc75c95ba9494ca2b5aca352bf916b',ramdisk_id='',reservation_id='r-v80c72ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-521133940',owner_user_name='tempest-VolumesNegativeTest-521133940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:53Z,user_data=None,user_id='cfb674e9bacc47eba54fc0e028ed1c77',uuid=95dfd223-db19-40c4-ac65-fcba4100e247,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Converting VIF {"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:36:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7ff400a-19a7-4da8-88e4-7c41d83690dc,network=Network(dbd18687-1e59-4379-a7d3-ccddadafebd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ff400a-19') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG os_vif [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:36:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7ff400a-19a7-4da8-88e4-7c41d83690dc,network=Network(dbd18687-1e59-4379-a7d3-ccddadafebd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ff400a-19') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd93bd411-f621-54a6-ae36-e64c9f37f8b3', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7ff400a-19, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7ff400a-19, col_values=(('qos', UUID('a3232cd3-f4e3-415e-8842-164207a718a9')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7ff400a-19, col_values=(('external_ids', {'iface-id': 'b7ff400a-19a7-4da8-88e4-7c41d83690dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:36:1a', 'vm-uuid': '95dfd223-db19-40c4-ac65-fcba4100e247'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:56 user nova-compute[75288]: INFO os_vif [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:36:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7ff400a-19a7-4da8-88e4-7c41d83690dc,network=Network(dbd18687-1e59-4379-a7d3-ccddadafebd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ff400a-19')
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] No VIF found with MAC fa:16:3e:2e:36:1a, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully created port: 71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-953419dc-ce41-44bc-9c00-eb3030b779ca req-c60feffb-7bfb-4341-971f-4d9edb84c1ac service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Updated VIF entry in instance network info cache for port b7ff400a-19a7-4da8-88e4-7c41d83690dc. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-953419dc-ce41-44bc-9c00-eb3030b779ca req-c60feffb-7bfb-4341-971f-4d9edb84c1ac service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Updating instance_info_cache with network_info: [{"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-953419dc-ce41-44bc-9c00-eb3030b779ca req-c60feffb-7bfb-4341-971f-4d9edb84c1ac service nova] Releasing lock "refresh_cache-95dfd223-db19-40c4-ac65-fcba4100e247" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully created port: b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully created port: 965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-ce25dc42-096d-44e2-9ee5-1a6d29e9d34f req-da97507b-05b3-48c9-a2d8-bfaa48bcb2a6 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received event network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ce25dc42-096d-44e2-9ee5-1a6d29e9d34f req-da97507b-05b3-48c9-a2d8-bfaa48bcb2a6 service nova] Acquiring lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ce25dc42-096d-44e2-9ee5-1a6d29e9d34f req-da97507b-05b3-48c9-a2d8-bfaa48bcb2a6 service nova] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ce25dc42-096d-44e2-9ee5-1a6d29e9d34f req-da97507b-05b3-48c9-a2d8-bfaa48bcb2a6 service nova] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-ce25dc42-096d-44e2-9ee5-1a6d29e9d34f req-da97507b-05b3-48c9-a2d8-bfaa48bcb2a6 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] No waiting events found dispatching network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:44:58 user nova-compute[75288]: WARNING nova.compute.manager [req-ce25dc42-096d-44e2-9ee5-1a6d29e9d34f req-da97507b-05b3-48c9-a2d8-bfaa48bcb2a6 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received unexpected event network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc for instance with vm_state building and task_state spawning.
Dec 01 13:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully updated port: 47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-59af77d2-e305-4d59-acfa-f988b4fc7e43 req-b968b529-031b-4efa-a5ba-2b2e7c65d724 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-changed-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-59af77d2-e305-4d59-acfa-f988b4fc7e43 req-b968b529-031b-4efa-a5ba-2b2e7c65d724 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing instance network info cache due to event network-changed-47d653ec-9fa1-4929-bf59-ae48e06726b4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59af77d2-e305-4d59-acfa-f988b4fc7e43 req-b968b529-031b-4efa-a5ba-2b2e7c65d724 service nova] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59af77d2-e305-4d59-acfa-f988b4fc7e43 req-b968b529-031b-4efa-a5ba-2b2e7c65d724 service nova] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-59af77d2-e305-4d59-acfa-f988b4fc7e43 req-b968b529-031b-4efa-a5ba-2b2e7c65d724 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing network info cache for port 47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-59af77d2-e305-4d59-acfa-f988b4fc7e43 req-b968b529-031b-4efa-a5ba-2b2e7c65d724 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-59af77d2-e305-4d59-acfa-f988b4fc7e43 req-b968b529-031b-4efa-a5ba-2b2e7c65d724 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:44:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59af77d2-e305-4d59-acfa-f988b4fc7e43 req-b968b529-031b-4efa-a5ba-2b2e7c65d724 service nova] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully updated port: bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully updated port: 8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:44:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Instance spawned successfully.
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:44:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:45:00 user nova-compute[75288]: INFO nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Took 6.77 seconds to spawn the instance on the hypervisor.
Dec 01 13:45:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-31782dfd-7e39-4270-bec8-75d1e737dc5d req-1ae35e18-0f18-4e81-8553-4793d3e8771c service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received event network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31782dfd-7e39-4270-bec8-75d1e737dc5d req-1ae35e18-0f18-4e81-8553-4793d3e8771c service nova] Acquiring lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31782dfd-7e39-4270-bec8-75d1e737dc5d req-1ae35e18-0f18-4e81-8553-4793d3e8771c service nova] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31782dfd-7e39-4270-bec8-75d1e737dc5d req-1ae35e18-0f18-4e81-8553-4793d3e8771c service nova] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-31782dfd-7e39-4270-bec8-75d1e737dc5d req-1ae35e18-0f18-4e81-8553-4793d3e8771c service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] No waiting events found dispatching network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:45:00 user nova-compute[75288]: WARNING nova.compute.manager [req-31782dfd-7e39-4270-bec8-75d1e737dc5d req-1ae35e18-0f18-4e81-8553-4793d3e8771c service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received unexpected event network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc for instance with vm_state building and task_state spawning.
Dec 01 13:45:00 user nova-compute[75288]: INFO nova.compute.manager [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Took 7.64 seconds to build instance.
Dec 01 13:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19bf3c3c-d787-4edd-b56b-10f44033af3b tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "95dfd223-db19-40c4-ac65-fcba4100e247" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.753s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully updated port: 35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-changed-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing instance network info cache due to event network-changed-bfbfc658-3b20-4753-8473-2a21b94fc8f1. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing network info cache for port bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully updated port: 71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-changed-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing instance network info cache due to event network-changed-8b872961-dfca-481d-a5f8-716d1d3d26d2. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing network info cache for port 8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-changed-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing instance network info cache due to event network-changed-35ce63be-f092-4ded-afef-aeffa88e5eeb. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing network info cache for port 35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully updated port: b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:45:01 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e788173-d19c-434a-bbe9-cac113bf9d45 req-a837f7b6-795e-4675-875a-a3ccbbde21da service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received event network-changed-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e788173-d19c-434a-bbe9-cac113bf9d45 req-a837f7b6-795e-4675-875a-a3ccbbde21da service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Refreshing instance network info cache due to event network-changed-e66de3d0-2331-4afa-8613-0cc8bc289deb. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e788173-d19c-434a-bbe9-cac113bf9d45 req-a837f7b6-795e-4675-875a-a3ccbbde21da service nova] Acquiring lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e788173-d19c-434a-bbe9-cac113bf9d45 req-a837f7b6-795e-4675-875a-a3ccbbde21da service nova] Acquired lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-8e788173-d19c-434a-bbe9-cac113bf9d45 req-a837f7b6-795e-4675-875a-a3ccbbde21da service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Refreshing network info cache for port e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f63f5b7-61b4-476d-bcb5-36ea1346fb75 req-0822e7c4-22c7-478b-b011-44cffaaa2edb service nova] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Successfully updated port: 965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-changed-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing instance network info cache due to event network-changed-71975ebb-9a52-41bd-b101-27e8c87b105b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-8e788173-d19c-434a-bbe9-cac113bf9d45 req-a837f7b6-795e-4675-875a-a3ccbbde21da service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updated VIF entry in instance network info cache for port e66de3d0-2331-4afa-8613-0cc8bc289deb. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-8e788173-d19c-434a-bbe9-cac113bf9d45 req-a837f7b6-795e-4675-875a-a3ccbbde21da service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e788173-d19c-434a-bbe9-cac113bf9d45 req-a837f7b6-795e-4675-875a-a3ccbbde21da service nova] Releasing lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:03 user nova-compute[75288]: INFO nova.compute.manager [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Rescuing
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquired lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updating instance_info_cache with network_info: [{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Releasing lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-3aa271d0-27d7-4b51-a121-73a08a727580 req-ee643f33-beed-4ecc-abd5-937a434c4ca9 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-unplugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3aa271d0-27d7-4b51-a121-73a08a727580 req-ee643f33-beed-4ecc-abd5-937a434c4ca9 service nova] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3aa271d0-27d7-4b51-a121-73a08a727580 req-ee643f33-beed-4ecc-abd5-937a434c4ca9 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3aa271d0-27d7-4b51-a121-73a08a727580 req-ee643f33-beed-4ecc-abd5-937a434c4ca9 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-3aa271d0-27d7-4b51-a121-73a08a727580 req-ee643f33-beed-4ecc-abd5-937a434c4ca9 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] No waiting events found dispatching network-vif-unplugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:45:04 user nova-compute[75288]: WARNING nova.compute.manager [req-3aa271d0-27d7-4b51-a121-73a08a727580 req-ee643f33-beed-4ecc-abd5-937a434c4ca9 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received unexpected event network-vif-unplugged-c2b41ea4-c8ed-404e-845c-38adea30e710 for instance with vm_state active and task_state rescuing.
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Instance destroyed successfully.
Dec 01 13:45:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Attempting rescue
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 13:45:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Creating image(s)
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'trusted_certs' on Instance uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue" returned: 0 in 0.056s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'migration_context' on Instance uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.base [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<97df1bf5-d682-435b-9b70-7252770a3d5a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Start _get_guest_xml network_info=[{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:6e:5d:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'resources' on Instance uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.base [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<97df1bf5-d682-435b-9b70-7252770a3d5a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'numa_topology' on Instance uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.base [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<97df1bf5-d682-435b-9b70-7252770a3d5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:45:04 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:45:04 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.base [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<97df1bf5-d682-435b-9b70-7252770a3d5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-799462005',display_name='tempest-ServerRescueNegativeTestJSON-server-799462005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-799462005',id=3,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-ymuw9f1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:31Z,user_data=None,user_id='cad75165194843718ebc8b886ab3b6b7',uuid=97df1bf5-d682-435b-9b70-7252770a3d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:6e:5d:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:6e:5d:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=c2b41ea4-c8ed-404e-845c-38adea30e710,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b41ea4-c8') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'pci_devices' on Instance uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.objects.base [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<97df1bf5-d682-435b-9b70-7252770a3d5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:45:04 user nova-compute[75288]:   <uuid>97df1bf5-d682-435b-9b70-7252770a3d5a</uuid>
Dec 01 13:45:04 user nova-compute[75288]:   <name>instance-00000003</name>
Dec 01 13:45:04 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:45:04 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:45:04 user nova-compute[75288]:   <metadata>
Dec 01 13:45:04 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:45:04 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:45:04 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-799462005</nova:name>
Dec 01 13:45:04 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:45:04</nova:creationTime>
Dec 01 13:45:04 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:45:04 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:45:04 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:45:04 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:45:04 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:45:04 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:45:04 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:45:04 user nova-compute[75288]:       <nova:owner>
Dec 01 13:45:04 user nova-compute[75288]:         <nova:user uuid="cad75165194843718ebc8b886ab3b6b7">tempest-ServerRescueNegativeTestJSON-1340015149-project-member</nova:user>
Dec 01 13:45:04 user nova-compute[75288]:         <nova:project uuid="a5854339bf9c4f3db4a3bf2c65ddc344">tempest-ServerRescueNegativeTestJSON-1340015149</nova:project>
Dec 01 13:45:04 user nova-compute[75288]:       </nova:owner>
Dec 01 13:45:04 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:45:04 user nova-compute[75288]:       <nova:ports>
Dec 01 13:45:04 user nova-compute[75288]:         <nova:port uuid="c2b41ea4-c8ed-404e-845c-38adea30e710">
Dec 01 13:45:04 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 13:45:04 user nova-compute[75288]:         </nova:port>
Dec 01 13:45:04 user nova-compute[75288]:       </nova:ports>
Dec 01 13:45:04 user nova-compute[75288]:     </nova:instance>
Dec 01 13:45:04 user nova-compute[75288]:   </metadata>
Dec 01 13:45:04 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:45:04 user nova-compute[75288]:     <system>
Dec 01 13:45:04 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:45:04 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:45:04 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:45:04 user nova-compute[75288]:       <entry name="serial">97df1bf5-d682-435b-9b70-7252770a3d5a</entry>
Dec 01 13:45:04 user nova-compute[75288]:       <entry name="uuid">97df1bf5-d682-435b-9b70-7252770a3d5a</entry>
Dec 01 13:45:04 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:45:04 user nova-compute[75288]:     </system>
Dec 01 13:45:04 user nova-compute[75288]:   </sysinfo>
Dec 01 13:45:04 user nova-compute[75288]:   <os>
Dec 01 13:45:04 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:45:04 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:45:04 user nova-compute[75288]:   </os>
Dec 01 13:45:04 user nova-compute[75288]:   <features>
Dec 01 13:45:04 user nova-compute[75288]:     <acpi/>
Dec 01 13:45:04 user nova-compute[75288]:     <apic/>
Dec 01 13:45:04 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:45:04 user nova-compute[75288]:   </features>
Dec 01 13:45:04 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:45:04 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:45:04 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:45:04 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:45:04 user nova-compute[75288]:   </clock>
Dec 01 13:45:04 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:45:04 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:45:04 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:45:04 user nova-compute[75288]:   </cpu>
Dec 01 13:45:04 user nova-compute[75288]:   <devices>
Dec 01 13:45:04 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:45:04 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:45:04 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue"/>
Dec 01 13:45:04 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:45:04 user nova-compute[75288]:     </disk>
Dec 01 13:45:04 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:45:04 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:45:04 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk"/>
Dec 01 13:45:04 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 13:45:04 user nova-compute[75288]:     </disk>
Dec 01 13:45:04 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:45:04 user nova-compute[75288]:       <mac address="fa:16:3e:6e:5d:2a"/>
Dec 01 13:45:04 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:45:04 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:45:04 user nova-compute[75288]:       <target dev="tapc2b41ea4-c8"/>
Dec 01 13:45:04 user nova-compute[75288]:     </interface>
Dec 01 13:45:04 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:45:04 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/console.log" append="off"/>
Dec 01 13:45:04 user nova-compute[75288]:     </serial>
Dec 01 13:45:04 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:45:04 user nova-compute[75288]:     <video>
Dec 01 13:45:04 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:45:04 user nova-compute[75288]:     </video>
Dec 01 13:45:04 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:45:04 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:45:04 user nova-compute[75288]:     </rng>
Dec 01 13:45:04 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:45:04 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:45:04 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:45:04 user nova-compute[75288]:     </memballoon>
Dec 01 13:45:04 user nova-compute[75288]:   </devices>
Dec 01 13:45:04 user nova-compute[75288]: </domain>
Dec 01 13:45:04 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:45:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Instance destroyed successfully.
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No VIF found with MAC fa:16:3e:6e:5d:2a, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance network_info: |[{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing network info cache for port 71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updated VIF entry in instance network info cache for port 71975ebb-9a52-41bd-b101-27e8c87b105b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-changed-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing instance network info cache due to event network-changed-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing network info cache for port b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updated VIF entry in instance network info cache for port b2583bac-f8d6-4dbd-ab70-e6086ea5c02a. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-changed-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing instance network info cache due to event network-changed-965a693f-d1e1-455c-a9b5-645428548617. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing network info cache for port 965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-ca2fab89-7ef9-4905-bf8b-1bf249e8d463 req-1fcc4f15-9f94-43f0-9d23-6ba9f1378844 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca2fab89-7ef9-4905-bf8b-1bf249e8d463 req-1fcc4f15-9f94-43f0-9d23-6ba9f1378844 service nova] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca2fab89-7ef9-4905-bf8b-1bf249e8d463 req-1fcc4f15-9f94-43f0-9d23-6ba9f1378844 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca2fab89-7ef9-4905-bf8b-1bf249e8d463 req-1fcc4f15-9f94-43f0-9d23-6ba9f1378844 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-ca2fab89-7ef9-4905-bf8b-1bf249e8d463 req-1fcc4f15-9f94-43f0-9d23-6ba9f1378844 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] No waiting events found dispatching network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:45:06 user nova-compute[75288]: WARNING nova.compute.manager [req-ca2fab89-7ef9-4905-bf8b-1bf249e8d463 req-1fcc4f15-9f94-43f0-9d23-6ba9f1378844 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received unexpected event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 for instance with vm_state active and task_state rescuing.
Dec 01 13:45:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updated VIF entry in instance network info cache for port 965a693f-d1e1-455c-a9b5-645428548617. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-288fc32c-b1f4-4543-beb3-a741e93456d2 req-c8cedbc8-c0f4-41c3-984f-83ef58e7a23f service nova] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] No waiting events found dispatching network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:45:08 user nova-compute[75288]: WARNING nova.compute.manager [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received unexpected event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 for instance with vm_state active and task_state rescuing.
Dec 01 13:45:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] No waiting events found dispatching network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:45:08 user nova-compute[75288]: WARNING nova.compute.manager [req-cfbbacbe-2f30-49e7-b021-ccb1017c2c4a req-6ca6e4d4-0d37-4400-8a5f-9e711ba76e59 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received unexpected event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 for instance with vm_state active and task_state rescuing.
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-19c2db04-9e98-4f1b-bcf8-e8c3cfd0c02a tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:45:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:09 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:45:09 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7139MB free_disk=25.52704620361328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2c66ff7f-d0d9-43ff-98a4-bb702780e080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d6528740-f062-4dd6-9b99-d41042e2abe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0ab72540-6333-4a3b-bb5f-411e607bac1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b2803270-b513-474d-8607-619f8582d6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 7834a8ee-1c0c-49e1-8b47-70ce3b64c702 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 95dfd223-db19-40c4-ac65-fcba4100e247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8541199a-393b-445d-8945-11fc3f9d0bd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:45:09 user nova-compute[75288]: INFO nova.compute.manager [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] instance snapshotting
Dec 01 13:45:09 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Beginning live snapshot process
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:45:09 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-changed-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Refreshing instance network info cache due to event network-changed-e41a567f-0fb6-4089-b693-d8d527576a17. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] Acquiring lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] Acquired lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Refreshing network info cache for port e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json -f qcow2" returned: 0 in 0.242s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.225s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr15pgp6j/fc1aa07038cd4deab513aad25f483e19.delta 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr15pgp6j/fc1aa07038cd4deab513aad25f483e19.delta 1073741824" returned: 0 in 0.051s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updated VIF entry in instance network info cache for port e41a567f-0fb6-4089-b693-d8d527576a17. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75288) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 01 13:45:10 user nova-compute[75288]: INFO nova.virt.libvirt.host [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] UEFI support detected
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] Releasing lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received event network-changed-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Refreshing instance network info cache due to event network-changed-94a9b395-6933-43ea-89a6-77157cac1f75. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] Acquiring lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] Acquired lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Refreshing network info cache for port 94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updated VIF entry in instance network info cache for port 94a9b395-6933-43ea-89a6-77157cac1f75. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating instance_info_cache with network_info: [{"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27b5db21-0aa5-4364-a108-3d1512239894 req-1368570f-8d53-423b-8b5e-4c7e11359722 service nova] Releasing lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] COPY block job progress, current cursor: 25952256 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:45:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:45:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 13:45:12 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:45:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr15pgp6j/fc1aa07038cd4deab513aad25f483e19.delta /opt/stack/data/nova/instances/snapshots/tmpr15pgp6j/fc1aa07038cd4deab513aad25f483e19 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr15pgp6j/fc1aa07038cd4deab513aad25f483e19.delta /opt/stack/data/nova/instances/snapshots/tmpr15pgp6j/fc1aa07038cd4deab513aad25f483e19" returned: 0 in 0.392s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Snapshot extracted, beginning image upload
Dec 01 13:45:15 user nova-compute[75288]: INFO nova.virt.block_device [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Booting with volume 649ecbff-97a1-4432-ae18-3e15b9c0dc87 at /dev/vdb
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.utils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10074ec-b7e0-4bef-8b04-4940791cf14e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb6e4c7-b774-4436-b277-740311e69428]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0794ce88-fa25-4508-a96f-e2bc28f8ff98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04988581-e5fe-46a6-9a2a-0d4b91a2f7ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:45:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Creating image(s)
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Ensure instance console log exists: /opt/stack/data/nova/instances/b2803270-b513-474d-8607-619f8582d6a0/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Start _get_guest_xml network_info=[{"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '26a669c9-7ab2-4b5d-8eca-f6ad48804ed6', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOtkAPsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b2803270-b513-474d-8607-619f8582d6a0', 'attached_at': '', 'detached_at': '', 'volume_id': '2ca862ab-5700-418a-a598-83f17f6a0fe3', 'serial': '2ca862ab-5700-418a-a598-83f17f6a0fe3'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:45:15 user nova-compute[75288]: INFO nova.virt.block_device [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Booting with volume 94e30106-6e40-4983-9b5f-35142952476c at /dev/vdb
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:15 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fae8a75-65ae-4080-8448-fbf1576e05a3]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.utils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating existing volume attachment record: 5ec24176-a84d-4db7-bf12-569a0c083bc6 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:45:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:45:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connector [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Factory for ISCSI on None {{(pid=75288) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOtkAPsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:15 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.utils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d933591e-29f4-47e7-97d4-b30daa80c50b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:45:15 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6a4846-d248-4d53-be72-185142c4bd14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac0b86-52c4-4740-9bc6-53c31ce90ceb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3] added
Dec 01 13:45:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6eabb3-10b5-4368-bbf0-a1a3a3a96795]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08c4cf7-d999-4d9e-a007-f014a3db7222]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.071s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e658df3-121c-477b-b451-7146736eb3a9]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c73227-3401-465b-bced-25ece7554e80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:15 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d6cb55-ecce-423f-ab52-3edbc3d79e6b]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG os_brick.utils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:15 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating existing volume attachment record: 1a320b2f-e31d-49bc-b015-ea84b70a636a {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.069s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[148d61f8-0765-4711-854a-c935a34fd3a2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iOtkAPsF {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iOtkAPsF" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aac322-649e-4e5f-b772-a0b87a462188]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iOtkAPsF'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7779b0e-4c0c-4901-a1cc-68ef1e8b7981]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b386d9a-95dc-4092-8f75-c9ac09661a0f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 13:45:16 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 13:45:16 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 13:45:16 user nova-compute[75288]: 
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa5fd9-3097-488e-85cd-b639eb4842a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3, portal: 172.16.0.220,3260]
Dec 01 13:45:16 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3, portal: 172.16.0.220,3260] successful.
Dec 01 13:45:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Snapshot image upload complete
Dec 01 13:45:16 user nova-compute[75288]: INFO nova.compute.manager [None req-ab37ccd0-65d9-400b-af87-f3f3cfa8b7aa tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Took 6.35 seconds to snapshot the instance on the hypervisor.
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.049s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63cee17-0532-48eb-98eb-be4d86f81cc8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d5119b-7e6d-4502-ab1d-6e2d35a21ed4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.491s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[871b2050-ab9c-4182-af93-1c71268254e3]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOtkAPsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.530s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== connect_volume: return (1532ms) {'type': 'block', 'scsi_wwn': '23131343633393665', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131343633393665', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931729115',display_name='tempest-TestVolumeBootPattern-server-1931729115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931729115',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-2k0hwweb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:39Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=b2803270-b513-474d-8607-619f8582d6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:ea,bridge_name='br-int',has_traffic_filtering=True,id=66cd67d7-779c-4a70-925b-baf5f49bbf20,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd67d7-77') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lazy-loading 'pci_devices' on Instance uuid b2803270-b513-474d-8607-619f8582d6a0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:45:17 user nova-compute[75288]:   <uuid>b2803270-b513-474d-8607-619f8582d6a0</uuid>
Dec 01 13:45:17 user nova-compute[75288]:   <name>instance-0000000a</name>
Dec 01 13:45:17 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:45:17 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:45:17 user nova-compute[75288]:   <metadata>
Dec 01 13:45:17 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:45:17 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:45:17 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-server-1931729115</nova:name>
Dec 01 13:45:17 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:45:15</nova:creationTime>
Dec 01 13:45:17 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:45:17 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:45:17 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:45:17 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:45:17 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:45:17 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:45:17 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:45:17 user nova-compute[75288]:       <nova:owner>
Dec 01 13:45:17 user nova-compute[75288]:         <nova:user uuid="ab6a9e09550e42edac3c1e8a9112fbd1">tempest-TestVolumeBootPattern-367476607-project-member</nova:user>
Dec 01 13:45:17 user nova-compute[75288]:         <nova:project uuid="1120cc4cc3d8458aaf5755a500e994c6">tempest-TestVolumeBootPattern-367476607</nova:project>
Dec 01 13:45:17 user nova-compute[75288]:       </nova:owner>
Dec 01 13:45:17 user nova-compute[75288]:       <nova:ports>
Dec 01 13:45:17 user nova-compute[75288]:         <nova:port uuid="66cd67d7-779c-4a70-925b-baf5f49bbf20">
Dec 01 13:45:17 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 13:45:17 user nova-compute[75288]:         </nova:port>
Dec 01 13:45:17 user nova-compute[75288]:       </nova:ports>
Dec 01 13:45:17 user nova-compute[75288]:     </nova:instance>
Dec 01 13:45:17 user nova-compute[75288]:   </metadata>
Dec 01 13:45:17 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:45:17 user nova-compute[75288]:     <system>
Dec 01 13:45:17 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:45:17 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:45:17 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:45:17 user nova-compute[75288]:       <entry name="serial">b2803270-b513-474d-8607-619f8582d6a0</entry>
Dec 01 13:45:17 user nova-compute[75288]:       <entry name="uuid">b2803270-b513-474d-8607-619f8582d6a0</entry>
Dec 01 13:45:17 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:45:17 user nova-compute[75288]:     </system>
Dec 01 13:45:17 user nova-compute[75288]:   </sysinfo>
Dec 01 13:45:17 user nova-compute[75288]:   <os>
Dec 01 13:45:17 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:45:17 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:45:17 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:45:17 user nova-compute[75288]:   </os>
Dec 01 13:45:17 user nova-compute[75288]:   <features>
Dec 01 13:45:17 user nova-compute[75288]:     <acpi/>
Dec 01 13:45:17 user nova-compute[75288]:     <apic/>
Dec 01 13:45:17 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:45:17 user nova-compute[75288]:   </features>
Dec 01 13:45:17 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:45:17 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:45:17 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:45:17 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:45:17 user nova-compute[75288]:   </clock>
Dec 01 13:45:17 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:45:17 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:45:17 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:45:17 user nova-compute[75288]:   </cpu>
Dec 01 13:45:17 user nova-compute[75288]:   <devices>
Dec 01 13:45:17 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:45:17 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:45:17 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Dec 01 13:45:17 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:45:17 user nova-compute[75288]:       <serial>2ca862ab-5700-418a-a598-83f17f6a0fe3</serial>
Dec 01 13:45:17 user nova-compute[75288]:     </disk>
Dec 01 13:45:17 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:45:17 user nova-compute[75288]:       <mac address="fa:16:3e:55:e0:ea"/>
Dec 01 13:45:17 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:45:17 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:45:17 user nova-compute[75288]:       <target dev="tap66cd67d7-77"/>
Dec 01 13:45:17 user nova-compute[75288]:     </interface>
Dec 01 13:45:17 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:45:17 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b2803270-b513-474d-8607-619f8582d6a0/console.log" append="off"/>
Dec 01 13:45:17 user nova-compute[75288]:     </serial>
Dec 01 13:45:17 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:45:17 user nova-compute[75288]:     <video>
Dec 01 13:45:17 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:45:17 user nova-compute[75288]:     </video>
Dec 01 13:45:17 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:45:17 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:45:17 user nova-compute[75288]:     </rng>
Dec 01 13:45:17 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:45:17 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:45:17 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:45:17 user nova-compute[75288]:     </memballoon>
Dec 01 13:45:17 user nova-compute[75288]:   </devices>
Dec 01 13:45:17 user nova-compute[75288]: </domain>
Dec 01 13:45:17 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931729115',display_name='tempest-TestVolumeBootPattern-server-1931729115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931729115',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-2k0hwweb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:39Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=b2803270-b513-474d-8607-619f8582d6a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:ea,bridge_name='br-int',has_traffic_filtering=True,id=66cd67d7-779c-4a70-925b-baf5f49bbf20,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd67d7-77') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG os_vif [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:ea,bridge_name='br-int',has_traffic_filtering=True,id=66cd67d7-779c-4a70-925b-baf5f49bbf20,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd67d7-77') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ceef0918-edec-594f-9df9-bc7a8ef52bfe', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66cd67d7-77, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66cd67d7-77, col_values=(('qos', UUID('8aca9725-ea92-46b7-98f1-d7bc7cebf059')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66cd67d7-77, col_values=(('external_ids', {'iface-id': '66cd67d7-779c-4a70-925b-baf5f49bbf20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:e0:ea', 'vm-uuid': 'b2803270-b513-474d-8607-619f8582d6a0'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:17 user nova-compute[75288]: INFO os_vif [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:ea,bridge_name='br-int',has_traffic_filtering=True,id=66cd67d7-779c-4a70-925b-baf5f49bbf20,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd67d7-77')
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] No VIF found with MAC fa:16:3e:55:e0:ea, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:45:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-f7e1845e-a4e2-48e6-a36e-5fde20feeb3e req-6fd9d94f-0b48-4ba3-8bf5-e1b9dab048cf service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received event network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7e1845e-a4e2-48e6-a36e-5fde20feeb3e req-6fd9d94f-0b48-4ba3-8bf5-e1b9dab048cf service nova] Acquiring lock "b2803270-b513-474d-8607-619f8582d6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7e1845e-a4e2-48e6-a36e-5fde20feeb3e req-6fd9d94f-0b48-4ba3-8bf5-e1b9dab048cf service nova] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7e1845e-a4e2-48e6-a36e-5fde20feeb3e req-6fd9d94f-0b48-4ba3-8bf5-e1b9dab048cf service nova] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-f7e1845e-a4e2-48e6-a36e-5fde20feeb3e req-6fd9d94f-0b48-4ba3-8bf5-e1b9dab048cf service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] No waiting events found dispatching network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:45:19 user nova-compute[75288]: WARNING nova.compute.manager [req-f7e1845e-a4e2-48e6-a36e-5fde20feeb3e req-6fd9d94f-0b48-4ba3-8bf5-e1b9dab048cf service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received unexpected event network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 for instance with vm_state building and task_state spawning.
Dec 01 13:45:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-a740e5d3-5b79-4b6d-9517-09e436424c76 req-5a89df78-c66c-4c5b-ae07-e8b3fe420553 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received event network-changed-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-a740e5d3-5b79-4b6d-9517-09e436424c76 req-5a89df78-c66c-4c5b-ae07-e8b3fe420553 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Refreshing instance network info cache due to event network-changed-92d8f57c-0605-4509-abe5-e66257f43917. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a740e5d3-5b79-4b6d-9517-09e436424c76 req-5a89df78-c66c-4c5b-ae07-e8b3fe420553 service nova] Acquiring lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a740e5d3-5b79-4b6d-9517-09e436424c76 req-5a89df78-c66c-4c5b-ae07-e8b3fe420553 service nova] Acquired lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:20 user nova-compute[75288]: DEBUG nova.network.neutron [req-a740e5d3-5b79-4b6d-9517-09e436424c76 req-5a89df78-c66c-4c5b-ae07-e8b3fe420553 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Refreshing network info cache for port 92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-a740e5d3-5b79-4b6d-9517-09e436424c76 req-5a89df78-c66c-4c5b-ae07-e8b3fe420553 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Updated VIF entry in instance network info cache for port 92d8f57c-0605-4509-abe5-e66257f43917. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-a740e5d3-5b79-4b6d-9517-09e436424c76 req-5a89df78-c66c-4c5b-ae07-e8b3fe420553 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Updating instance_info_cache with network_info: [{"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b2803270-b513-474d-8607-619f8582d6a0] Instance spawned successfully.
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a740e5d3-5b79-4b6d-9517-09e436424c76 req-5a89df78-c66c-4c5b-ae07-e8b3fe420553 service nova] Releasing lock "refresh_cache-d6528740-f062-4dd6-9b99-d41042e2abe4" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lazy-loading 'flavor' on Instance uuid d6528740-f062-4dd6-9b99-d41042e2abe4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:21 user nova-compute[75288]: INFO nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Took 5.52 seconds to spawn the instance on the hypervisor.
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-a64829fc-0c29-4aa0-9483-3c078cc4cf94 req-2cf001da-f8f1-4de8-898e-eb85f4e20a25 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received event network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a64829fc-0c29-4aa0-9483-3c078cc4cf94 req-2cf001da-f8f1-4de8-898e-eb85f4e20a25 service nova] Acquiring lock "b2803270-b513-474d-8607-619f8582d6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a64829fc-0c29-4aa0-9483-3c078cc4cf94 req-2cf001da-f8f1-4de8-898e-eb85f4e20a25 service nova] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a64829fc-0c29-4aa0-9483-3c078cc4cf94 req-2cf001da-f8f1-4de8-898e-eb85f4e20a25 service nova] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-a64829fc-0c29-4aa0-9483-3c078cc4cf94 req-2cf001da-f8f1-4de8-898e-eb85f4e20a25 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] No waiting events found dispatching network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:45:21 user nova-compute[75288]: WARNING nova.compute.manager [req-a64829fc-0c29-4aa0-9483-3c078cc4cf94 req-2cf001da-f8f1-4de8-898e-eb85f4e20a25 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received unexpected event network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 for instance with vm_state building and task_state spawning.
Dec 01 13:45:21 user nova-compute[75288]: INFO nova.compute.manager [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Took 42.58 seconds to build instance.
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f6687558-d7d5-4859-acac-0033d7d5c7b1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "b2803270-b513-474d-8607-619f8582d6a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.679s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:21 user nova-compute[75288]: INFO nova.compute.manager [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Attaching volume db7963a1-9d17-45e5-b771-6e36ca0cfcf2 to /dev/vdb
Dec 01 13:45:21 user nova-compute[75288]: DEBUG os_brick.utils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6581d620-f4f6-48ce-89c2-2f06dcd79b43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[14220ecd-efd2-4307-a4f3-3ad6a218950c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bc72c5-e5ce-4e6b-b11a-550ecfec0f15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[467b5078-0217-4afe-978e-4769fe8d8ae5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:21 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[059b937b-2913-4f37-b9b6-e3259237ac0e]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG os_brick.utils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Updating existing volume attachment record: 6523a7df-6e8e-4699-b736-223909440b0a {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:45:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9d284b3-e0cb-48ec-af05-09730d621838 req-ac5f91e7-7cd2-447e-90f5-f4cad3ac7c2d service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received event network-changed-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9d284b3-e0cb-48ec-af05-09730d621838 req-ac5f91e7-7cd2-447e-90f5-f4cad3ac7c2d service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Refreshing instance network info cache due to event network-changed-36f04c68-844f-43a3-956e-3a484a23b4c3. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9d284b3-e0cb-48ec-af05-09730d621838 req-ac5f91e7-7cd2-447e-90f5-f4cad3ac7c2d service nova] Acquiring lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9d284b3-e0cb-48ec-af05-09730d621838 req-ac5f91e7-7cd2-447e-90f5-f4cad3ac7c2d service nova] Acquired lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9d284b3-e0cb-48ec-af05-09730d621838 req-ac5f91e7-7cd2-447e-90f5-f4cad3ac7c2d service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Refreshing network info cache for port 36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9d284b3-e0cb-48ec-af05-09730d621838 req-ac5f91e7-7cd2-447e-90f5-f4cad3ac7c2d service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updated VIF entry in instance network info cache for port 36f04c68-844f-43a3-956e-3a484a23b4c3. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-f9d284b3-e0cb-48ec-af05-09730d621838 req-ac5f91e7-7cd2-447e-90f5-f4cad3ac7c2d service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updating instance_info_cache with network_info: [{"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9d284b3-e0cb-48ec-af05-09730d621838 req-ac5f91e7-7cd2-447e-90f5-f4cad3ac7c2d service nova] Releasing lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:31 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:31 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:31 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdac5459-beaf-443e-9de8-9b538db715b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:45:31 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4defa-20bf-4717-9643-421e8cd094cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2] added
Dec 01 13:45:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60e21b4-bf77-4435-bb50-af22a69e16cc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1967186-9be5-46d9-af3c-003119718739]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrCxLpDO {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrCxLpDO" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f10b21e-6a40-416b-bf49-54cd05ebc7bb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrCxLpDO'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83bc097-9632-4ee7-94ae-a3bf44822326]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55805d6-52be-4253-9696-f61235217d37]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[307a76df-3f1b-4c6e-a506-99fdbadf60f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260]
Dec 01 13:45:31 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260] successful.
Dec 01 13:45:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[592b3057-b85e-4084-b32f-af55c5a63527]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36767b7-9a68-421d-98ed-7b2a8bc5fa7f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:31 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:31 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b89952-fd70-49f8-9fd2-0248d68e7321]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:45:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26565313136626162', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565313136626162', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lazy-loading 'flavor' on Instance uuid d6528740-f062-4dd6-9b99-d41042e2abe4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-59db75fa-01e8-43f2-8ae2-57b0e6dfeb62 req-335fe9f0-f4f0-4d12-9cc5-4435b2c4b1bd service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received event network-changed-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-59db75fa-01e8-43f2-8ae2-57b0e6dfeb62 req-335fe9f0-f4f0-4d12-9cc5-4435b2c4b1bd service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Refreshing instance network info cache due to event network-changed-4dda3cf3-235d-4f36-907d-7bf4620fb7a8. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59db75fa-01e8-43f2-8ae2-57b0e6dfeb62 req-335fe9f0-f4f0-4d12-9cc5-4435b2c4b1bd service nova] Acquiring lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59db75fa-01e8-43f2-8ae2-57b0e6dfeb62 req-335fe9f0-f4f0-4d12-9cc5-4435b2c4b1bd service nova] Acquired lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-59db75fa-01e8-43f2-8ae2-57b0e6dfeb62 req-335fe9f0-f4f0-4d12-9cc5-4435b2c4b1bd service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Refreshing network info cache for port 4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:45:32 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:45:32 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 13:45:32 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:45:32 user nova-compute[75288]:   <serial>db7963a1-9d17-45e5-b771-6e36ca0cfcf2</serial>
Dec 01 13:45:32 user nova-compute[75288]: </disk>
Dec 01 13:45:32 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-95ac7bf9-fb3c-4c52-bcca-326b5f1ca0aa req-9e21eadb-75e3-4397-9895-3a5407c2d11b service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received event network-changed-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-95ac7bf9-fb3c-4c52-bcca-326b5f1ca0aa req-9e21eadb-75e3-4397-9895-3a5407c2d11b service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Refreshing instance network info cache due to event network-changed-cf3a6053-9edf-4e08-9a42-b4227eae8e1b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-95ac7bf9-fb3c-4c52-bcca-326b5f1ca0aa req-9e21eadb-75e3-4397-9895-3a5407c2d11b service nova] Acquiring lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-95ac7bf9-fb3c-4c52-bcca-326b5f1ca0aa req-9e21eadb-75e3-4397-9895-3a5407c2d11b service nova] Acquired lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-95ac7bf9-fb3c-4c52-bcca-326b5f1ca0aa req-9e21eadb-75e3-4397-9895-3a5407c2d11b service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Refreshing network info cache for port cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-59db75fa-01e8-43f2-8ae2-57b0e6dfeb62 req-335fe9f0-f4f0-4d12-9cc5-4435b2c4b1bd service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Updated VIF entry in instance network info cache for port 4dda3cf3-235d-4f36-907d-7bf4620fb7a8. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-59db75fa-01e8-43f2-8ae2-57b0e6dfeb62 req-335fe9f0-f4f0-4d12-9cc5-4435b2c4b1bd service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Updating instance_info_cache with network_info: [{"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59db75fa-01e8-43f2-8ae2-57b0e6dfeb62 req-335fe9f0-f4f0-4d12-9cc5-4435b2c4b1bd service nova] Releasing lock "refresh_cache-b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] No VIF found with MAC fa:16:3e:b3:8e:fc, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.objects.instance [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lazy-loading 'flavor' on Instance uuid c1ede7e1-e693-455e-ade4-8c1a02418ae0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b2244611-1c13-4e4f-a0ac-f7fb4844dda4 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.144s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-95ac7bf9-fb3c-4c52-bcca-326b5f1ca0aa req-9e21eadb-75e3-4397-9895-3a5407c2d11b service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Updated VIF entry in instance network info cache for port cf3a6053-9edf-4e08-9a42-b4227eae8e1b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-95ac7bf9-fb3c-4c52-bcca-326b5f1ca0aa req-9e21eadb-75e3-4397-9895-3a5407c2d11b service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Updating instance_info_cache with network_info: [{"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-95ac7bf9-fb3c-4c52-bcca-326b5f1ca0aa req-9e21eadb-75e3-4397-9895-3a5407c2d11b service nova] Releasing lock "refresh_cache-c1ede7e1-e693-455e-ade4-8c1a02418ae0" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:33 user nova-compute[75288]: INFO nova.compute.manager [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Attaching volume 312e8455-efc1-4eb8-9901-48a0b829bf8c to /dev/vdb
Dec 01 13:45:33 user nova-compute[75288]: DEBUG os_brick.utils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[840710fc-db97-4ed0-9b70-1f834f2b3bcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ab577-6a4d-4d17-93b0-2430aef04255]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[42051f9f-1517-4497-a81d-86e3e5dc295d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a54252-bb96-4a47-a735-9d2f90f3ffdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:33 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c950b629-3c6c-4104-8887-31eb7f372549]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG os_brick.utils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:33 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Updating existing volume attachment record: 19a89854-28a6-47e0-b497-f17d9b9c2e4f {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:45:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lazy-loading 'flavor' on Instance uuid 0ab72540-6333-4a3b-bb5f-411e607bac1d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.209s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:37 user nova-compute[75288]: INFO nova.virt.block_device [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Booting with volume 401625e6-8a94-47a2-bd63-271b7866c5b1 at /dev/vdc
Dec 01 13:45:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.007s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:37 user nova-compute[75288]: INFO nova.compute.manager [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Attaching volume dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f to /dev/vdb
Dec 01 13:45:37 user nova-compute[75288]: INFO nova.virt.block_device [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Booting with volume 3fa53c26-3d5e-4577-bfd4-dc8063df793d at /dev/vdc
Dec 01 13:45:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lazy-loading 'flavor' on Instance uuid b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e870a57-c5a9-4b91-a543-1ccde7ea6453]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea486ed7-8e1d-47c9-8c2b-52bdf3b3b1cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1337d20b-2d59-4073-a1b2-89d8053054f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc88ac-ce84-4d32-ac31-4a55e860ae14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.150s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[419ce7fd-890f-4373-9f52-205d42e72805]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:37 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb42268-8b38-4106-a58d-380db2491fc3]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b4cd5-816b-465c-bfe7-e046ef0f15b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be9821-daf4-404e-9ec9-d464a56ac645]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73516ad-b9fc-45eb-9dbf-dec76e89c618]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86cbb4a-0c3c-4054-b160-a5cfab7ffd87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0870eb9f-baee-4fc8-8af7-8c61e48b31e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d941e-a399-486b-81ed-776be88120c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6480a151-5c15-440a-b551-b6725300aeda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2751461f-f963-4096-a117-f792cb3bdefb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7420ac1-af25-4dfd-af34-582857f5648f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[378a6d5b-44f1-4b95-bebc-dab01a2833bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:37 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab23769-bc60-48d9-853c-3a4fe68ff43e]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating existing volume attachment record: d2c92555-292d-4c9d-b742-8543a81a76e0 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a1e92e-c281-476e-93b7-d4183e9238d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: INFO nova.compute.manager [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Swapping volume db7963a1-9d17-45e5-b771-6e36ca0cfcf2 for 7cd2167e-a242-430e-b9f0-e60095f494e4
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:37 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e5e6a8-8c59-484b-8d7d-7a27f2a3045e]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] <== get_connector_properties: return (243ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updating existing volume attachment record: 0da960c9-b696-4010-861d-8d1b486e6f13 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:37 user nova-compute[75288]: INFO nova.compute.manager [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Attaching volume 44b26dbd-adda-4537-a8fe-938641aa3526 to /dev/sdc
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:37 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b164dd5-c9fc-41ea-b088-32cda15f9e55]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:37 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating existing volume attachment record: e31cb77b-4ef4-49f9-9f38-9115fde39fa2 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:45:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CurnkscX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:43 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:45:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41cb3e2-9f30-4920-8584-20e9f8ba4792]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:45:43 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd60ce71-0637-4555-8cc4-04f48076ae77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c] added
Dec 01 13:45:43 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4605f89-205d-476e-b237-a6f9324a4df0]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b43d9a-aed8-4b8f-ad82-463d58a2a3f1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CurnkscX {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CurnkscX" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a44f5ab-fca6-4ae8-8a0a-f68e0e6d06bb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CurnkscX'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14381f3-ff7a-4e23-8f28-7b445052127f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0012e7-2df7-4bfe-ae73-6ea3fbdda5e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:44 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:44 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18132472-1127-4609-901e-904068863fc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c, portal: 172.16.0.220,3260]
Dec 01 13:45:44 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c, portal: 172.16.0.220,3260] successful.
Dec 01 13:45:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[55655a94-3f98-4526-b0c8-e11607acb85c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[387dabb6-5d0f-46c3-b19b-849e0901f61d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:44 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:44 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:44 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:44 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c5cde-598b-4482-abaf-fe22ca75d6bf]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:45:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CurnkscX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:45:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23137336234353762', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137336234353762', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:45:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lazy-loading 'flavor' on Instance uuid c1ede7e1-e693-455e-ade4-8c1a02418ae0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] attach device xml: <disk type="block" device="disk">
Dec 01 13:45:45 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:45:45 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:45:45 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:45:45 user nova-compute[75288]:   <serial>312e8455-efc1-4eb8-9901-48a0b829bf8c</serial>
Dec 01 13:45:45 user nova-compute[75288]: </disk>
Dec 01 13:45:45 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:45:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] No VIF found with MAC fa:16:3e:0e:83:37, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:45:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMfcKoeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:54 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2617094-7672-449a-a3ec-431d3aef6b02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:45:54 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e1d1ac-c915-482c-bf45-75abe4eb23d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f] added
Dec 01 13:45:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ebf187-7709-472c-914a-bfc72904c311]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6845f23-d0ef-4aeb-86f0-8558ee0eb73c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMfcKoeu {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMfcKoeu" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[046aea1b-f94d-40be-a396-af8e42d6ad1e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tMfcKoeu'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feeaf4d-c286-4dfa-b8a7-ea249ed65add]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf67c62-37ee-4e2b-bd21-05c1a572a988]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a5824e-01f0-4ee6-8874-0be120f2f5c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f, portal: 172.16.0.220,3260]
Dec 01 13:45:54 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f, portal: 172.16.0.220,3260] successful.
Dec 01 13:45:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[52753021-a153-4c69-98d6-94a527a01673]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e8620c-38e5-4b3e-a5b4-ed71cd3b602c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:54 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b45ad-12df-4996-b310-72aefa92669d]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMfcKoeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23161313763633065', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161313763633065', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lazy-loading 'flavor' on Instance uuid 0ab72540-6333-4a3b-bb5f-411e607bac1d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:45:55 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:45:55 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:45:55 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:45:55 user nova-compute[75288]:   <serial>dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f</serial>
Dec 01 13:45:55 user nova-compute[75288]: </disk>
Dec 01 13:45:55 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:45:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] No VIF found with MAC fa:16:3e:a8:95:07, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:45:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMApNOUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6528740-f062-4dd6-9b99-d41042e2abe4', 'attached_at': '', 'detached_at': '', 'volume_id': '7cd2167e-a242-430e-b9f0-e60095f494e4', 'serial': '7cd2167e-a242-430e-b9f0-e60095f494e4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd6528740-f062-4dd6-9b99-d41042e2abe4', 'attached_at': '', 'detached_at': '', 'volume_id': 'db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'serial'} {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMApNOUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:57 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b114e6-e98e-4f4f-a28e-a304c63a8c30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:45:57 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[632b1a9f-1733-4534-84ea-e27964864a3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4] added
Dec 01 13:45:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f7deac-f369-4d85-b878-9487a56acedb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.utils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-53e2155a-3514-4452-a95e-9f018e419e03 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.169s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.116s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a0e1d-6a4d-44ad-af07-31733573a3fa]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMApNOUx {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd42570f-2208-48b2-bc7e-ca8faa260686]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMApNOUx" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[21265815-1cdb-4f0f-8f41-6d01f451cfe9]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMApNOUx'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7127f9-5227-4ea9-9f41-7bfcc4e8ad95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[52832a04-7d4b-4405-bddf-4b8e92b31aeb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ec2aa367-a4ba-462f-9926-56e6dfb14c24 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.396s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4002bb64-ed7e-4407-9046-deb4d645bd76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e08f5f-fb64-4caf-9382-2f6485f46cd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7051bacf-9b18-4375-a9de-fd5ea43fd67c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:57 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:57 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:57 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:57 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:57 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:57 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:45:57 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:45:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee7f2b7-052d-4ef5-8af5-d24208bb8332]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.utils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Updating existing volume attachment record: adab2010-748b-404a-90d0-8e7f7bf1319b {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54be9d1e-4bad-4baf-9932-6c45f544efe0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4, portal: 172.16.0.220,3260]
Dec 01 13:45:58 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4, portal: 172.16.0.220,3260] successful.
Dec 01 13:45:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:45:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Creating image(s)
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Ensure instance console log exists: /opt/stack/data/nova/instances/7834a8ee-1c0c-49e1-8b47-70ce3b64c702/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Start _get_guest_xml network_info=[{"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '89998a62-d7fd-40e9-92aa-5bd464a560ef', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxbnqURQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702', 'attached_at': '', 'detached_at': '', 'volume_id': 'f962286e-7129-4755-9a1d-4c9c67bd3f53', 'serial': 'f962286e-7129-4755-9a1d-4c9c67bd3f53'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '5ec24176-a84d-4db7-bf12-569a0c083bc6', 'boot_index': 1, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPXbhCos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702', 'attached_at': '', 'detached_at': '', 'volume_id': '649ecbff-97a1-4432-ae18-3e15b9c0dc87', 'serial': '649ecbff-97a1-4432-ae18-3e15b9c0dc87'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'd2c92555-292d-4c9d-b742-8543a81a76e0', 'boot_index': 2, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzOQjsbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702', 'attached_at': '', 'detached_at': '', 'volume_id': '401625e6-8a94-47a2-bd63-271b7866c5b1', 'serial': '401625e6-8a94-47a2-bd63-271b7866c5b1'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[054a0dd0-b682-4422-b271-cf56e5c656e9]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:45:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxbnqURQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:45:58 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52fdd14-40f4-484a-b06a-350e02da0a98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:58 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:58 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:58 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:58 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:45:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:58 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:58 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:58 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:58 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:45:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[419e4b0b-bcf1-4f1e-8be0-1aaff6784299]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:45:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMApNOUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-49f9d4f6-d9a1-4644-8bc3-e60540bf9fc0 tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] volume_snapshot_create: create_info: {'snapshot_id': '2954a01e-2b81-41be-87c8-7dc47111650c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75288) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-49f9d4f6-d9a1-4644-8bc3-e60540bf9fc0 tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] snap xml: <domainsnapshot>
Dec 01 13:45:59 user nova-compute[75288]:   <disks>
Dec 01 13:45:59 user nova-compute[75288]:     <disk name="/dev/sdd" snapshot="external" type="file">
Dec 01 13:45:59 user nova-compute[75288]:       <source file="/dev/new_file"/>
Dec 01 13:45:59 user nova-compute[75288]:     </disk>
Dec 01 13:45:59 user nova-compute[75288]:     <disk name="vda" snapshot="no"/>
Dec 01 13:45:59 user nova-compute[75288]:   </disks>
Dec 01 13:45:59 user nova-compute[75288]: </domainsnapshot>
Dec 01 13:45:59 user nova-compute[75288]:  {{(pid=75288) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-49f9d4f6-d9a1-4644-8bc3-e60540bf9fc0 tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] Lazy-loading 'system_metadata' on Instance uuid c1ede7e1-e693-455e-ade4-8c1a02418ae0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-49f9d4f6-d9a1-4644-8bc3-e60540bf9fc0 tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-863803e2-8e22-4ac8-ae17-c4ad04acf10e tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] volume_snapshot_delete: delete_info: {'volume_id': '312e8455-efc1-4eb8-9901-48a0b829bf8c'} {{(pid=75288) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-863803e2-8e22-4ac8-ae17-c4ad04acf10e tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     if delete_info['type'] != 'qcow2':
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] KeyError: 'type'
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] 
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.506s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] <== connect_volume: return (1507ms) {'type': 'block', 'scsi_wwn': '26639333062363633', 'path': '/dev/sdf'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639333062363633', 'path': '/dev/sdf'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-49f9d4f6-d9a1-4644-8bc3-e60540bf9fc0 tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     rv = execute(f, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     six.reraise(c, e, tb)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     raise value
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     rv = meth(*args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-49f9d4f6-d9a1-4644-8bc3-e60540bf9fc0 tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     self._volume_snapshot_create(context, instance, guest,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     rv = execute(f, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     six.reraise(c, e, tb)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     raise value
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     rv = meth(*args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] 
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.086s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:59 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:45:59 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lazy-loading 'flavor' on Instance uuid d6528740-f062-4dd6-9b99-d41042e2abe4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc27e3-c110-4a69-8b1d-a271857d5747]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:45:59 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-863803e2-8e22-4ac8-ae17-c4ad04acf10e tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-6a7c9614-a709-43fa-9d16-ffaec68f3c95)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62121f6-50af-4d41-b276-3f8917900efa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53] added
Dec 01 13:45:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server [None req-863803e2-8e22-4ac8-ae17-c4ad04acf10e tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] Exception during message handling: KeyError: 'type'
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server 
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[968a96d6-fa6e-48f4-8e8c-044124c666b7]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver [None req-49f9d4f6-d9a1-4644-8bc3-e60540bf9fc0 tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 2954a01e-2b81-41be-87c8-7dc47111650c could not be found.
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise value
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 2954a01e-2b81-41be-87c8-7dc47111650c could not be found. (HTTP 404) (Request-ID: req-9b7eb486-3522-407f-87b1-d9e7a2ce7114)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 2954a01e-2b81-41be-87c8-7dc47111650c could not be found.
Dec 01 13:45:59 user nova-compute[75288]: ERROR nova.virt.libvirt.driver 
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2493c9b7-5a27-4fad-bcd0-8b40f0371d8b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server [None req-49f9d4f6-d9a1-4644-8bc3-e60540bf9fc0 tempest-VolumesAssistedSnapshotsTest-1787718276 tempest-VolumesAssistedSnapshotsTest-1787718276-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise value
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 13:45:59 user nova-compute[75288]: ERROR oslo_messaging.rpc.server 
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxbnqURQ {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxbnqURQ" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[493968b5-4f3d-4414-a01f-0c7bda1cc57f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxbnqURQ'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[053ef3cf-fd2f-43e1-b353-b066ecc44f2f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[640fd238-7910-4581-8070-e65461ad3b19]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f0731-9afa-4624-b2b0-aceffb11ce72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53, portal: 172.16.0.220,3260]
Dec 01 13:45:59 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53, portal: 172.16.0.220,3260] successful.
Dec 01 13:45:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac6e289-2565-46c9-aee0-f37711c7722f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:59 user nova-compute[75288]: INFO nova.compute.manager [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Detaching volume 312e8455-efc1-4eb8-9901-48a0b829bf8c
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb68bf4-57fb-40c6-8a81-d55d812913a3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:45:59 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e442f-2471-4548-88b8-e10d99e3cb34]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxbnqURQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:45:59 user nova-compute[75288]: INFO nova.virt.block_device [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Attempting to driver detach volume 312e8455-efc1-4eb8-9901-48a0b829bf8c from mountpoint /dev/vdb
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Attempting to detach device vdb from instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] detach device xml: <disk type="block" device="disk">
Dec 01 13:45:59 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:45:59 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:45:59 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:45:59 user nova-compute[75288]:   <serial>312e8455-efc1-4eb8-9901-48a0b829bf8c</serial>
Dec 01 13:45:59 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:45:59 user nova-compute[75288]: </disk>
Dec 01 13:45:59 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:45:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Successfully detached device vdb from instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 from the persistent domain config.
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] detach device xml: <disk type="block" device="disk">
Dec 01 13:45:59 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:45:59 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:45:59 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:45:59 user nova-compute[75288]:   <serial>312e8455-efc1-4eb8-9901-48a0b829bf8c</serial>
Dec 01 13:45:59 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:45:59 user nova-compute[75288]: </disk>
Dec 01 13:45:59 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:45:59 user nova-compute[75288]: INFO nova.compute.manager [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Detaching volume dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f
Dec 01 13:45:59 user nova-compute[75288]: INFO nova.virt.block_device [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Attempting to driver detach volume dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f from mountpoint /dev/vdb
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Attempting to detach device vdb from instance 0ab72540-6333-4a3b-bb5f-411e607bac1d from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:45:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:45:59 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:45:59 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:45:59 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:45:59 user nova-compute[75288]:   <serial>dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f</serial>
Dec 01 13:45:59 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:45:59 user nova-compute[75288]: </disk>
Dec 01 13:45:59 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:46:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Successfully detached device vdb from instance 0ab72540-6333-4a3b-bb5f-411e607bac1d from the persistent domain config.
Dec 01 13:46:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ab72540-6333-4a3b-bb5f-411e607bac1d from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:46:00 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:00 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:46:00 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:46:00 user nova-compute[75288]:   <serial>dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f</serial>
Dec 01 13:46:00 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:46:00 user nova-compute[75288]: </disk>
Dec 01 13:46:00 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 166723584 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== connect_volume: return (2477ms) {'type': 'block', 'scsi_wwn': '26564363635373466', 'path': '/dev/sdg'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564363635373466', 'path': '/dev/sdg'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPXbhCos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:00 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:00 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:00 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:46:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ab72540-6333-4a3b-bb5f-411e607bac1d {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[debf40cd-89f9-437c-9375-ea05bfd173b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:46:00 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4d1f6d-3c03-4a74-a6a2-0c8c50020e23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87] added
Dec 01 13:46:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 342884352 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61b1dd-742a-4c55-a818-ef399cf1ccfd]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e446946d-848c-483e-8883-05ae150f1acf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPXbhCos {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPXbhCos" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251ddda-f533-436c-91d7-5f68fa586de3]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DPXbhCos'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[737e28fa-86c5-4c7a-aa6a-5e2b218e518c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c74ece-4704-4a02-a4b5-1761390adeea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:00 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5bfbe-16f0-4a96-9996-655f74bd7c88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87, portal: 172.16.0.220,3260]
Dec 01 13:46:00 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba98d975-6d9c-41fd-b237-0b55d8f0b8bf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acee0c6-0fda-48b6-b969-eb3a151f2a75]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36588ac-c321-4206-b6b5-073ca7061b0e]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 527433728 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 695205888 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPXbhCos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23932306533643061', 'path': '/dev/sdh'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932306533643061', 'path': '/dev/sdh'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzOQjsbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:02 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7a54b7-4cae-47aa-89c4-9347134c91fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:46:02 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb98d61-e9af-4ccb-9096-74cd9f35ec59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1] added
Dec 01 13:46:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 812646400 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef433a0-ea47-4965-84a6-7f9d00c0047a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bafa1f-3a98-48a5-a969-74349eb3efbc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzOQjsbk {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzOQjsbk" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d54d15-d5d9-4e11-8314-eb630eb23aff]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SzOQjsbk'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2995508e-668e-480f-930b-02bde19cd8dd]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a1372b-8700-4350-bb98-25980e68c257]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f148e4c-c698-4421-8d4f-8b5a51cb74ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1, portal: 172.16.0.220,3260]
Dec 01 13:46:02 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0136b-5b7e-4036-8410-346021f181c4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[479707f9-7af2-491c-85b5-d6304abd0b06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f272fd-54ed-4357-8e3f-ed7d267255f8]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 944766976 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:03 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzOQjsbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '26637336665303965', 'path': '/dev/sdi'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637336665303965', 'path': '/dev/sdi'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.211s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5084be9-4887-4ab5-bc9e-587f4eaf7253]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:46:03 user nova-compute[75288]: No targets found.
Dec 01 13:46:03 user nova-compute[75288]: iSNS:
Dec 01 13:46:03 user nova-compute[75288]: No targets found.
Dec 01 13:46:03 user nova-compute[75288]: STATIC:
Dec 01 13:46:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:46:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:03 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c
Dec 01 13:46:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:03 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4
Dec 01 13:46:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:03 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:03 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3
Dec 01 13:46:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:03 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:46:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:03 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:46:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:03 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:03 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f
Dec 01 13:46:03 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:03 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:03 user nova-compute[75288]: FIRMWARE:
Dec 01 13:46:03 user nova-compute[75288]: No targets found.
Dec 01 13:46:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:46:03 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:46:03 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:03:c3,bridge_name='br-int',has_traffic_filtering=True,id=4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2,network=Network(71d8cac8-2f61-4212-bd51-88aed5c3b3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c862e27-9d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=c8144593-0826-4a56-bcb1-0eb7faa68f3a,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc8144593-08') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=22ecad86-3a29-4f33-88d9-10a4b10569f5,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ecad86-3a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=689e9e88-11d4-4fdb-9762-ee44d52fe74d,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689e9e88-11') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:d3:c4,bridge_name='br-int',has_traffic_filtering=True,id=5c91590c-ef72-4c8e-8b32-405d39bbed6f,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c91590c-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ca:49,bridge_name='br-int',has_traffic_filtering=True,id=63109067-3882-4582-85c2-b0e33c24ce6f,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63109067-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:f7,bridge_name='br-int',has_traffic_filtering=True,id=eea6e247-33fe-41c7-82d5-58ffbf9187fc,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea6e247-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lazy-loading 'pci_devices' on Instance uuid 7834a8ee-1c0c-49e1-8b47-70ce3b64c702 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27dcd9f-853f-4da5-8584-f9da53459ea8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:46:03 user nova-compute[75288]:   <uuid>7834a8ee-1c0c-49e1-8b47-70ce3b64c702</uuid>
Dec 01 13:46:03 user nova-compute[75288]:   <name>instance-0000000b</name>
Dec 01 13:46:03 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:46:03 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:46:03 user nova-compute[75288]:   <metadata>
Dec 01 13:46:03 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:46:03 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:46:03 user nova-compute[75288]:       <nova:name>tempest-device-tagging-server-1185027924</nova:name>
Dec 01 13:46:03 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:45:58</nova:creationTime>
Dec 01 13:46:03 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:46:03 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:46:03 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:46:03 user nova-compute[75288]:       <nova:owner>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:user uuid="18550a125f0a418c9d9c4565e26f5358">tempest-TaggedBootDevicesTest_v242-1913742395-project-member</nova:user>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:project uuid="6bc0d4c7e27d4241be2c3ea05267de7a">tempest-TaggedBootDevicesTest_v242-1913742395</nova:project>
Dec 01 13:46:03 user nova-compute[75288]:       </nova:owner>
Dec 01 13:46:03 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:46:03 user nova-compute[75288]:       <nova:ports>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:port uuid="4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2">
Dec 01 13:46:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 01 13:46:03 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:port uuid="c8144593-0826-4a56-bcb1-0eb7faa68f3a">
Dec 01 13:46:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.151" ipVersion="4"/>
Dec 01 13:46:03 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:port uuid="22ecad86-3a29-4f33-88d9-10a4b10569f5">
Dec 01 13:46:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.47" ipVersion="4"/>
Dec 01 13:46:03 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:port uuid="689e9e88-11d4-4fdb-9762-ee44d52fe74d">
Dec 01 13:46:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.133" ipVersion="4"/>
Dec 01 13:46:03 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:port uuid="5c91590c-ef72-4c8e-8b32-405d39bbed6f">
Dec 01 13:46:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.252" ipVersion="4"/>
Dec 01 13:46:03 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:port uuid="63109067-3882-4582-85c2-b0e33c24ce6f">
Dec 01 13:46:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 01 13:46:03 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:03 user nova-compute[75288]:         <nova:port uuid="eea6e247-33fe-41c7-82d5-58ffbf9187fc">
Dec 01 13:46:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 01 13:46:03 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:03 user nova-compute[75288]:       </nova:ports>
Dec 01 13:46:03 user nova-compute[75288]:     </nova:instance>
Dec 01 13:46:03 user nova-compute[75288]:   </metadata>
Dec 01 13:46:03 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:46:03 user nova-compute[75288]:     <system>
Dec 01 13:46:03 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:46:03 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:46:03 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:46:03 user nova-compute[75288]:       <entry name="serial">7834a8ee-1c0c-49e1-8b47-70ce3b64c702</entry>
Dec 01 13:46:03 user nova-compute[75288]:       <entry name="uuid">7834a8ee-1c0c-49e1-8b47-70ce3b64c702</entry>
Dec 01 13:46:03 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:46:03 user nova-compute[75288]:     </system>
Dec 01 13:46:03 user nova-compute[75288]:   </sysinfo>
Dec 01 13:46:03 user nova-compute[75288]:   <os>
Dec 01 13:46:03 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:46:03 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:46:03 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:46:03 user nova-compute[75288]:   </os>
Dec 01 13:46:03 user nova-compute[75288]:   <features>
Dec 01 13:46:03 user nova-compute[75288]:     <acpi/>
Dec 01 13:46:03 user nova-compute[75288]:     <apic/>
Dec 01 13:46:03 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:46:03 user nova-compute[75288]:   </features>
Dec 01 13:46:03 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:46:03 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:46:03 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:46:03 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:46:03 user nova-compute[75288]:   </clock>
Dec 01 13:46:03 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:46:03 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:46:03 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:46:03 user nova-compute[75288]:   </cpu>
Dec 01 13:46:03 user nova-compute[75288]:   <devices>
Dec 01 13:46:03 user nova-compute[75288]:     <disk type="file" device="cdrom">
Dec 01 13:46:03 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 13:46:03 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/7834a8ee-1c0c-49e1-8b47-70ce3b64c702/disk.config"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="hda" bus="ide"/>
Dec 01 13:46:03 user nova-compute[75288]:     </disk>
Dec 01 13:46:03 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:46:03 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:03 user nova-compute[75288]:       <source dev="/dev/sdg"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <serial>f962286e-7129-4755-9a1d-4c9c67bd3f53</serial>
Dec 01 13:46:03 user nova-compute[75288]:     </disk>
Dec 01 13:46:03 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:46:03 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:03 user nova-compute[75288]:       <source dev="/dev/sdh"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <serial>649ecbff-97a1-4432-ae18-3e15b9c0dc87</serial>
Dec 01 13:46:03 user nova-compute[75288]:     </disk>
Dec 01 13:46:03 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:46:03 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:03 user nova-compute[75288]:       <source dev="/dev/sdi"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="vdc" bus="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <serial>401625e6-8a94-47a2-bd63-271b7866c5b1</serial>
Dec 01 13:46:03 user nova-compute[75288]:     </disk>
Dec 01 13:46:03 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:03 user nova-compute[75288]:       <mac address="fa:16:3e:f0:03:c3"/>
Dec 01 13:46:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="tap4c862e27-9d"/>
Dec 01 13:46:03 user nova-compute[75288]:     </interface>
Dec 01 13:46:03 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:03 user nova-compute[75288]:       <mac address="fa:16:3e:da:6c:93"/>
Dec 01 13:46:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="tapc8144593-08"/>
Dec 01 13:46:03 user nova-compute[75288]:     </interface>
Dec 01 13:46:03 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:03 user nova-compute[75288]:       <mac address="fa:16:3e:f2:8b:b5"/>
Dec 01 13:46:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="tap22ecad86-3a"/>
Dec 01 13:46:03 user nova-compute[75288]:     </interface>
Dec 01 13:46:03 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:03 user nova-compute[75288]:       <mac address="fa:16:3e:61:2b:d3"/>
Dec 01 13:46:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="tap689e9e88-11"/>
Dec 01 13:46:03 user nova-compute[75288]:     </interface>
Dec 01 13:46:03 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:03 user nova-compute[75288]:       <mac address="fa:16:3e:84:d3:c4"/>
Dec 01 13:46:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="tap5c91590c-ef"/>
Dec 01 13:46:03 user nova-compute[75288]:     </interface>
Dec 01 13:46:03 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:03 user nova-compute[75288]:       <mac address="fa:16:3e:6d:ca:49"/>
Dec 01 13:46:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="tap63109067-38"/>
Dec 01 13:46:03 user nova-compute[75288]:     </interface>
Dec 01 13:46:03 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:03 user nova-compute[75288]:       <mac address="fa:16:3e:f7:c9:f7"/>
Dec 01 13:46:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:03 user nova-compute[75288]:       <target dev="tapeea6e247-33"/>
Dec 01 13:46:03 user nova-compute[75288]:     </interface>
Dec 01 13:46:03 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:46:03 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/7834a8ee-1c0c-49e1-8b47-70ce3b64c702/console.log" append="off"/>
Dec 01 13:46:03 user nova-compute[75288]:     </serial>
Dec 01 13:46:03 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:46:03 user nova-compute[75288]:     <video>
Dec 01 13:46:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:03 user nova-compute[75288]:     </video>
Dec 01 13:46:03 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:46:03 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:46:03 user nova-compute[75288]:     </rng>
Dec 01 13:46:03 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:46:03 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:46:03 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:46:03 user nova-compute[75288]:     </memballoon>
Dec 01 13:46:03 user nova-compute[75288]:   </devices>
Dec 01 13:46:03 user nova-compute[75288]: </domain>
Dec 01 13:46:03 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:03:c3,bridge_name='br-int',has_traffic_filtering=True,id=4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2,network=Network(71d8cac8-2f61-4212-bd51-88aed5c3b3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c862e27-9d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:03:c3,bridge_name='br-int',has_traffic_filtering=True,id=4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2,network=Network(71d8cac8-2f61-4212-bd51-88aed5c3b3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c862e27-9d') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5929a089-0a43-5bf9-9e92-15781b2bac03', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c862e27-9d, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c862e27-9d, col_values=(('qos', UUID('a638725b-6d55-48c2-b298-328b604ee09e')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c862e27-9d, col_values=(('external_ids', {'iface-id': '4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:03:c3', 'vm-uuid': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e371e59-7ace-420b-83c0-98ee8710af7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e3a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a37f70b-0753-450f-99c3-3de2214d4e67]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb784ab-aa74-48d6-8dd4-2b599e084102]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: INFO os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:03:c3,bridge_name='br-int',has_traffic_filtering=True,id=4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2,network=Network(71d8cac8-2f61-4212-bd51-88aed5c3b3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c862e27-9d')
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=c8144593-0826-4a56-bcb1-0eb7faa68f3a,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc8144593-08') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=c8144593-0826-4a56-bcb1-0eb7faa68f3a,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc8144593-08') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2635742-39ee-486e-90b3-e1b8c87ba821]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9011b765-dfe7-5d8f-accb-902404add087', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8144593-08, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8144593-08, col_values=(('qos', UUID('7ef5a86c-d538-43b6-8809-9825f72685b5')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8144593-08, col_values=(('external_ids', {'iface-id': 'c8144593-0826-4a56-bcb1-0eb7faa68f3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:6c:93', 'vm-uuid': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0a4d57-8e46-4afb-9e95-7dd42cb21ae5]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: INFO os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=c8144593-0826-4a56-bcb1-0eb7faa68f3a,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc8144593-08')
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=22ecad86-3a29-4f33-88d9-10a4b10569f5,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ecad86-3a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=22ecad86-3a29-4f33-88d9-10a4b10569f5,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ecad86-3a') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '939e1dda-a887-55e7-b78d-90fed67660cd', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d99515-c681-4d62-8cba-0244838b85d3]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22ecad86-3a, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22ecad86-3a, col_values=(('qos', UUID('569327be-8b80-47eb-967e-2d24e7ac62b4')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22ecad86-3a, col_values=(('external_ids', {'iface-id': '22ecad86-3a29-4f33-88d9-10a4b10569f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:8b:b5', 'vm-uuid': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: INFO os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=22ecad86-3a29-4f33-88d9-10a4b10569f5,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ecad86-3a')
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=689e9e88-11d4-4fdb-9762-ee44d52fe74d,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689e9e88-11') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=689e9e88-11d4-4fdb-9762-ee44d52fe74d,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689e9e88-11') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e352e09e-ecdc-531d-b8f1-d90e8a4e30d5', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99bddd-c46d-4383-90f3-9e4eeae8b559]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260]
Dec 01 13:46:03 user nova-compute[75288]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap689e9e88-11, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap689e9e88-11, col_values=(('qos', UUID('ac396072-1d92-4276-8341-48b8de06e14e')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap689e9e88-11, col_values=(('external_ids', {'iface-id': '689e9e88-11d4-4fdb-9762-ee44d52fe74d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:2b:d3', 'vm-uuid': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7750f6a2-2183-4b32-8f07-313839d4b183]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] <== disconnect_volume: return (577ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: INFO os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=689e9e88-11d4-4fdb-9762-ee44d52fe74d,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689e9e88-11')
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:d3:c4,bridge_name='br-int',has_traffic_filtering=True,id=5c91590c-ef72-4c8e-8b32-405d39bbed6f,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c91590c-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:d3:c4,bridge_name='br-int',has_traffic_filtering=True,id=5c91590c-ef72-4c8e-8b32-405d39bbed6f,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c91590c-ef') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff9286d2-98ab-546f-9413-b46ba864fb75', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMApNOUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd6528740-f062-4dd6-9b99-d41042e2abe4', 'attached_at': '', 'detached_at': '', 'volume_id': '7cd2167e-a242-430e-b9f0-e60095f494e4', 'serial'} {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] swap_volume: removing Cinder connection for volume db7963a1-9d17-45e5-b771-6e36ca0cfcf2 {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c91590c-ef, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c91590c-ef, col_values=(('qos', UUID('781538da-abec-4ea3-b5b1-7093d55f3bb7')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c91590c-ef, col_values=(('external_ids', {'iface-id': '5c91590c-ef72-4c8e-8b32-405d39bbed6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:d3:c4', 'vm-uuid': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: INFO os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:d3:c4,bridge_name='br-int',has_traffic_filtering=True,id=5c91590c-ef72-4c8e-8b32-405d39bbed6f,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c91590c-ef')
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ca:49,bridge_name='br-int',has_traffic_filtering=True,id=63109067-3882-4582-85c2-b0e33c24ce6f,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63109067-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ca:49,bridge_name='br-int',has_traffic_filtering=True,id=63109067-3882-4582-85c2-b0e33c24ce6f,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63109067-38') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0bead98-0e04-501b-a1bd-4bdeb27e6a50', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63109067-38, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63109067-38, col_values=(('qos', UUID('fedb59b9-fa7e-4a45-a2d5-68ea44b62cf1')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63109067-38, col_values=(('external_ids', {'iface-id': '63109067-3882-4582-85c2-b0e33c24ce6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:ca:49', 'vm-uuid': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: INFO os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ca:49,bridge_name='br-int',has_traffic_filtering=True,id=63109067-3882-4582-85c2-b0e33c24ce6f,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63109067-38')
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:f7,bridge_name='br-int',has_traffic_filtering=True,id=eea6e247-33fe-41c7-82d5-58ffbf9187fc,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea6e247-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:f7,bridge_name='br-int',has_traffic_filtering=True,id=eea6e247-33fe-41c7-82d5-58ffbf9187fc,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea6e247-33') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e874ec74-8200-50c4-be43-34abd48231b6', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeea6e247-33, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeea6e247-33, col_values=(('qos', UUID('20fd97eb-24c0-40a3-93b7-c7d45b8b1275')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeea6e247-33, col_values=(('external_ids', {'iface-id': 'eea6e247-33fe-41c7-82d5-58ffbf9187fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:c9:f7', 'vm-uuid': '7834a8ee-1c0c-49e1-8b47-70ce3b64c702'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:04 user nova-compute[75288]: INFO os_vif [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:f7,bridge_name='br-int',has_traffic_filtering=True,id=eea6e247-33fe-41c7-82d5-58ffbf9187fc,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea6e247-33')
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] No VIF found with MAC fa:16:3e:f0:03:c3, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] No VIF found with MAC fa:16:3e:84:d3:c4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:46:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Using config drive
Dec 01 13:46:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Creating config drive at /opt/stack/data/nova/instances/7834a8ee-1c0c-49e1-8b47-70ce3b64c702/disk.config
Dec 01 13:46:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7834a8ee-1c0c-49e1-8b47-70ce3b64c702/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz16zelg3 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7834a8ee-1c0c-49e1-8b47-70ce3b64c702/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz16zelg3" returned: 0 in 0.066s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] swap_volume: Updating volume db7963a1-9d17-45e5-b771-6e36ca0cfcf2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "zMApNOUx", "auth_password": "JDfB3trdq2I0UO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "7cd2167e-a242-430e-b9f0-e60095f494e4"}, "status": "reserved", "instance": "d6528740-f062-4dd6-9b99-d41042e2abe4", "attached_at": "", "detached_at": "", "volume_id": "7cd2167e-a242-430e-b9f0-e60095f494e4", "serial": "7cd2167e-a242-430e-b9f0-e60095f494e4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7cd2167e-a242-430e-b9f0-e60095f494e4', 'no_device': None, 'attachment_id': '9c708a7a-1fc4-45fd-9bc6-f0ee2a55814d'} {{(pid=75288) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9a34810e-7980-4715-a7a2-1c409abebdac tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 27.583s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.utils [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad87c0f-9572-4d24-8b6f-ce0af8919837]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d65fd-aeea-4f49-bdcc-a1fcc000e27c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd4f16-81fb-4733-a8b9-113e8885955e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64eaf57-f04e-4d6b-bc6f-ac827bd82768]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:46:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Creating image(s)
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Ensure instance console log exists: /opt/stack/data/nova/instances/8541199a-393b-445d-8945-11fc3f9d0bd9/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Start _get_guest_xml network_info=[{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2c85b9b0-603d-44c1-bb01-b05579b1f2d3', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DujsSWUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8541199a-393b-445d-8945-11fc3f9d0bd9', 'attached_at': '', 'detached_at': '', 'volume_id': '40010598-b7e8-4a05-bcaa-6291feb5fe21', 'serial': '40010598-b7e8-4a05-bcaa-6291feb5fe21'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': '1a320b2f-e31d-49bc-b015-ea84b70a636a', 'boot_index': 1, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TnyfOHpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8541199a-393b-445d-8945-11fc3f9d0bd9', 'attached_at': '', 'detached_at': '', 'volume_id': '94e30106-6e40-4983-9b5f-35142952476c', 'serial': '94e30106-6e40-4983-9b5f-35142952476c'}, 'device_type': 'disk', 'volume_type': None}, {'attachment_id': 'e31cb77b-4ef4-49f9-9f38-9115fde39fa2', 'boot_index': 2, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaTSIwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8541199a-393b-445d-8945-11fc3f9d0bd9', 'attached_at': '', 'detached_at': '', 'volume_id': '3fa53c26-3d5e-4577-bfd4-dc8063df793d', 'serial': '3fa53c26-3d5e-4577-bfd4-dc8063df793d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:46:05 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3132d1-944a-4cd3-b57e-c138f76397a7]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.utils [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:05 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:46:05 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DujsSWUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:05 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:05 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:05 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c625d1e3-4f5b-43bd-a5b6-f84c25f9954b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:46:05 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba5e983-7496-4739-9d8d-fd18236ae30a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21] added
Dec 01 13:46:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: INFO nova.compute.manager [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Swapping volume 7cd2167e-a242-430e-b9f0-e60095f494e4 for db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d2268a-60e3-4ba9-82e8-c83c47c9054b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ae6901-6987-4326-b84c-1faa92bf5d64]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DujsSWUy {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DujsSWUy" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[33592342-8a70-4db0-b58c-98ac18d9f033]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DujsSWUy'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace4fb69-2710-4e7b-9aba-2466fb63448b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44e0f93-d346-42d1-ab9a-a54175b14063]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55062c1-bd2b-4280-a8df-0c4bcdf4a9ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21, portal: 172.16.0.220,3260]
Dec 01 13:46:06 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:06 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a675902-cd28-41b0-a59d-0b3a3fbe3eb6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab93148-5b47-4000-a9d3-062a27de3827]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:06 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4beab6f8-68cb-4600-bc82-aeb36601aa01]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DujsSWUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-d0439fd9-3cef-4ef3-bc1d-145a441f1b51 req-268a93a2-25ad-4163-bc19-80e632c8f841 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d0439fd9-3cef-4ef3-bc1d-145a441f1b51 req-268a93a2-25ad-4163-bc19-80e632c8f841 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d0439fd9-3cef-4ef3-bc1d-145a441f1b51 req-268a93a2-25ad-4163-bc19-80e632c8f841 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d0439fd9-3cef-4ef3-bc1d-145a441f1b51 req-268a93a2-25ad-4163-bc19-80e632c8f841 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-d0439fd9-3cef-4ef3-bc1d-145a441f1b51 req-268a93a2-25ad-4163-bc19-80e632c8f841 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:06 user nova-compute[75288]: WARNING nova.compute.manager [req-d0439fd9-3cef-4ef3-bc1d-145a441f1b51 req-268a93a2-25ad-4163-bc19-80e632c8f841 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 for instance with vm_state building and task_state spawning.
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23935616533303833', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935616533303833', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TnyfOHpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:07 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:07 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:07 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[20713679-36e9-404e-acb7-de376af70c78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:46:07 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c64850-e2a4-449b-b9a8-48845107f2c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c] added
Dec 01 13:46:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782bf6a-0583-4ee8-a0fc-ab542b527408]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c5f8d-79e1-4959-a951-daea3475eb2e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TnyfOHpz {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TnyfOHpz" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61c96e7-fb5e-44f4-922b-afb56d6340db]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TnyfOHpz'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b83c3-96d0-49f7-be8b-fe825c50831d]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d572838-c8c7-4ea5-a9c5-496930750ecb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d1a591-96a3-4db6-9674-ddbc3fe84bac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c, portal: 172.16.0.220,3260]
Dec 01 13:46:07 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe75d99-efad-4696-baf5-4baf542a7d67]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c59b34-06cf-47cb-b623-e652dec9ae83]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1023b692-8e15-4088-9b36-0d98885569a4]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TnyfOHpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:07 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updating instance_info_cache with network_info: [{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-95438887-0f93-44de-adc8-c043047f8c4e req-2568152a-9dbc-498c-ba04-dc4d63b323eb service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-95438887-0f93-44de-adc8-c043047f8c4e req-2568152a-9dbc-498c-ba04-dc4d63b323eb service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-95438887-0f93-44de-adc8-c043047f8c4e req-2568152a-9dbc-498c-ba04-dc4d63b323eb service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-95438887-0f93-44de-adc8-c043047f8c4e req-2568152a-9dbc-498c-ba04-dc4d63b323eb service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-95438887-0f93-44de-adc8-c043047f8c4e req-2568152a-9dbc-498c-ba04-dc4d63b323eb service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING nova.compute.manager [req-95438887-0f93-44de-adc8-c043047f8c4e req-2568152a-9dbc-498c-ba04-dc4d63b323eb service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f for instance with vm_state building and task_state spawning.
Dec 01 13:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-195ba5a7-4c4f-4f4d-b9a9-751af4abf40f req-95500e7c-fb24-4782-88d1-0c9e100558d2 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-195ba5a7-4c4f-4f4d-b9a9-751af4abf40f req-95500e7c-fb24-4782-88d1-0c9e100558d2 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-195ba5a7-4c4f-4f4d-b9a9-751af4abf40f req-95500e7c-fb24-4782-88d1-0c9e100558d2 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-195ba5a7-4c4f-4f4d-b9a9-751af4abf40f req-95500e7c-fb24-4782-88d1-0c9e100558d2 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-195ba5a7-4c4f-4f4d-b9a9-751af4abf40f req-95500e7c-fb24-4782-88d1-0c9e100558d2 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING nova.compute.manager [req-195ba5a7-4c4f-4f4d-b9a9-751af4abf40f req-95500e7c-fb24-4782-88d1-0c9e100558d2 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc for instance with vm_state building and task_state spawning.
Dec 01 13:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 for instance with vm_state building and task_state spawning.
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a for instance with vm_state building and task_state spawning.
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a for instance with vm_state building and task_state spawning.
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 for instance with vm_state building and task_state spawning.
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 for instance with vm_state building and task_state spawning.
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING nova.compute.manager [req-8cb987c9-bba9-4c86-a639-e98e09c63960 req-21bc4c35-48d6-43ca-9951-b230cada4fe5 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d for instance with vm_state building and task_state spawning.
Dec 01 13:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.498s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26531336532343061', 'path': '/dev/sdj'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531336532343061', 'path': '/dev/sdj'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaTSIwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:08 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2535ff99-1ce1-44ee-97a5-92ed451073f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:46:08 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a020b5-97b0-4e45-9f57-393f50158569]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d] added
Dec 01 13:46:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[139af52b-8154-4f39-bef4-2ffb24521dde]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3224d626-dd8b-4557-963b-2d3b74bdc574]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaTSIwqD {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FaTSIwqD" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc90069f-1bab-4480-8a42-d1311b7f1ece]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FaTSIwqD'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a187b31f-1c0e-40b8-8b8c-ee550700bc65]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b25205c-eede-4ba7-b925-c0d94341937f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ba233-2c88-47bc-8633-36f370a9ddbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d, portal: 172.16.0.220,3260]
Dec 01 13:46:09 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8444443d-d696-4025-afe3-6661ebe91c65]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d43a552-67e8-4a22-abda-9cb16e2f401f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:09 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5761a70-5806-4e9d-8cb0-c1af506cab8e]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaTSIwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-d43b6686-6670-4506-9c8e-a09b81392d9e req-b5b8e075-532c-437a-8592-4a8d4fe7a40d service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d43b6686-6670-4506-9c8e-a09b81392d9e req-b5b8e075-532c-437a-8592-4a8d4fe7a40d service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d43b6686-6670-4506-9c8e-a09b81392d9e req-b5b8e075-532c-437a-8592-4a8d4fe7a40d service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d43b6686-6670-4506-9c8e-a09b81392d9e req-b5b8e075-532c-437a-8592-4a8d4fe7a40d service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-d43b6686-6670-4506-9c8e-a09b81392d9e req-b5b8e075-532c-437a-8592-4a8d4fe7a40d service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:10 user nova-compute[75288]: WARNING nova.compute.manager [req-d43b6686-6670-4506-9c8e-a09b81392d9e req-b5b8e075-532c-437a-8592-4a8d4fe7a40d service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f for instance with vm_state building and task_state spawning.
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== connect_volume: return (1502ms) {'type': 'block', 'scsi_wwn': '23832336533626465', 'path': '/dev/sdk'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832336533626465', 'path': '/dev/sdk'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:28,bridge_name='br-int',has_traffic_filtering=True,id=47d653ec-9fa1-4929-bf59-ae48e06726b4,network=Network(4d76c275-d734-4546-9496-9a86957e7231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d653ec-9f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:52:26,bridge_name='br-int',has_traffic_filtering=True,id=bfbfc658-3b20-4753-8473-2a21b94fc8f1,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfbfc658-3b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2d:20,bridge_name='br-int',has_traffic_filtering=True,id=8b872961-dfca-481d-a5f8-716d1d3d26d2,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b872961-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=35ce63be-f092-4ded-afef-aeffa88e5eeb,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ce63be-f0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c2:d7,bridge_name='br-int',has_traffic_filtering=True,id=71975ebb-9a52-41bd-b101-27e8c87b105b,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71975ebb-9a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:7a,bridge_name='br-int',has_traffic_filtering=True,id=b2583bac-f8d6-4dbd-ab70-e6086ea5c02a,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2583bac-f8') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=965a693f-d1e1-455c-a9b5-645428548617,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965a693f-d1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lazy-loading 'pci_devices' on Instance uuid 8541199a-393b-445d-8945-11fc3f9d0bd9 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-4eb781bd-7ad8-41df-b331-ca676b9dcc6a req-5fe3060b-9852-45b2-baab-08cef455f98e service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4eb781bd-7ad8-41df-b331-ca676b9dcc6a req-5fe3060b-9852-45b2-baab-08cef455f98e service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4eb781bd-7ad8-41df-b331-ca676b9dcc6a req-5fe3060b-9852-45b2-baab-08cef455f98e service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4eb781bd-7ad8-41df-b331-ca676b9dcc6a req-5fe3060b-9852-45b2-baab-08cef455f98e service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-4eb781bd-7ad8-41df-b331-ca676b9dcc6a req-5fe3060b-9852-45b2-baab-08cef455f98e service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:10 user nova-compute[75288]: WARNING nova.compute.manager [req-4eb781bd-7ad8-41df-b331-ca676b9dcc6a req-5fe3060b-9852-45b2-baab-08cef455f98e service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc for instance with vm_state building and task_state spawning.
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:46:10 user nova-compute[75288]:   <uuid>8541199a-393b-445d-8945-11fc3f9d0bd9</uuid>
Dec 01 13:46:10 user nova-compute[75288]:   <name>instance-0000000d</name>
Dec 01 13:46:10 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:46:10 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:46:10 user nova-compute[75288]:   <metadata>
Dec 01 13:46:10 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:46:10 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:46:10 user nova-compute[75288]:       <nova:name>tempest-device-tagging-server-936605216</nova:name>
Dec 01 13:46:10 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:46:05</nova:creationTime>
Dec 01 13:46:10 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:46:10 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:46:10 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:46:10 user nova-compute[75288]:       <nova:owner>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:user uuid="bb0b77c33fae4ec6904a365da24cff8c">tempest-TaggedBootDevicesTest-525104724-project-member</nova:user>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:project uuid="95bdefcd6dad4213a733b8ba90eb0c61">tempest-TaggedBootDevicesTest-525104724</nova:project>
Dec 01 13:46:10 user nova-compute[75288]:       </nova:owner>
Dec 01 13:46:10 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:46:10 user nova-compute[75288]:       <nova:ports>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:port uuid="47d653ec-9fa1-4929-bf59-ae48e06726b4">
Dec 01 13:46:10 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:46:10 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:port uuid="bfbfc658-3b20-4753-8473-2a21b94fc8f1">
Dec 01 13:46:10 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Dec 01 13:46:10 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:port uuid="8b872961-dfca-481d-a5f8-716d1d3d26d2">
Dec 01 13:46:10 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Dec 01 13:46:10 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:port uuid="35ce63be-f092-4ded-afef-aeffa88e5eeb">
Dec 01 13:46:10 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Dec 01 13:46:10 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:port uuid="71975ebb-9a52-41bd-b101-27e8c87b105b">
Dec 01 13:46:10 user nova-compute[75288]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Dec 01 13:46:10 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:port uuid="b2583bac-f8d6-4dbd-ab70-e6086ea5c02a">
Dec 01 13:46:10 user nova-compute[75288]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 01 13:46:10 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:10 user nova-compute[75288]:         <nova:port uuid="965a693f-d1e1-455c-a9b5-645428548617">
Dec 01 13:46:10 user nova-compute[75288]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 01 13:46:10 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:10 user nova-compute[75288]:       </nova:ports>
Dec 01 13:46:10 user nova-compute[75288]:     </nova:instance>
Dec 01 13:46:10 user nova-compute[75288]:   </metadata>
Dec 01 13:46:10 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:46:10 user nova-compute[75288]:     <system>
Dec 01 13:46:10 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:46:10 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:46:10 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:46:10 user nova-compute[75288]:       <entry name="serial">8541199a-393b-445d-8945-11fc3f9d0bd9</entry>
Dec 01 13:46:10 user nova-compute[75288]:       <entry name="uuid">8541199a-393b-445d-8945-11fc3f9d0bd9</entry>
Dec 01 13:46:10 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:46:10 user nova-compute[75288]:     </system>
Dec 01 13:46:10 user nova-compute[75288]:   </sysinfo>
Dec 01 13:46:10 user nova-compute[75288]:   <os>
Dec 01 13:46:10 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:46:10 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:46:10 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:46:10 user nova-compute[75288]:   </os>
Dec 01 13:46:10 user nova-compute[75288]:   <features>
Dec 01 13:46:10 user nova-compute[75288]:     <acpi/>
Dec 01 13:46:10 user nova-compute[75288]:     <apic/>
Dec 01 13:46:10 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:46:10 user nova-compute[75288]:   </features>
Dec 01 13:46:10 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:46:10 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:46:10 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:46:10 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:46:10 user nova-compute[75288]:   </clock>
Dec 01 13:46:10 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:46:10 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:46:10 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:46:10 user nova-compute[75288]:   </cpu>
Dec 01 13:46:10 user nova-compute[75288]:   <devices>
Dec 01 13:46:10 user nova-compute[75288]:     <disk type="file" device="cdrom">
Dec 01 13:46:10 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 13:46:10 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/8541199a-393b-445d-8945-11fc3f9d0bd9/disk.config"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="hda" bus="ide"/>
Dec 01 13:46:10 user nova-compute[75288]:     </disk>
Dec 01 13:46:10 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:46:10 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:10 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <serial>40010598-b7e8-4a05-bcaa-6291feb5fe21</serial>
Dec 01 13:46:10 user nova-compute[75288]:     </disk>
Dec 01 13:46:10 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:46:10 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:10 user nova-compute[75288]:       <source dev="/dev/sdj"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <serial>94e30106-6e40-4983-9b5f-35142952476c</serial>
Dec 01 13:46:10 user nova-compute[75288]:     </disk>
Dec 01 13:46:10 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:46:10 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:10 user nova-compute[75288]:       <source dev="/dev/sdk"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="vdc" bus="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <serial>3fa53c26-3d5e-4577-bfd4-dc8063df793d</serial>
Dec 01 13:46:10 user nova-compute[75288]:     </disk>
Dec 01 13:46:10 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:10 user nova-compute[75288]:       <mac address="fa:16:3e:8e:7e:28"/>
Dec 01 13:46:10 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="tap47d653ec-9f"/>
Dec 01 13:46:10 user nova-compute[75288]:     </interface>
Dec 01 13:46:10 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:10 user nova-compute[75288]:       <mac address="fa:16:3e:1c:52:26"/>
Dec 01 13:46:10 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="tapbfbfc658-3b"/>
Dec 01 13:46:10 user nova-compute[75288]:     </interface>
Dec 01 13:46:10 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:10 user nova-compute[75288]:       <mac address="fa:16:3e:f0:2d:20"/>
Dec 01 13:46:10 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="tap8b872961-df"/>
Dec 01 13:46:10 user nova-compute[75288]:     </interface>
Dec 01 13:46:10 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:10 user nova-compute[75288]:       <mac address="fa:16:3e:d7:f5:33"/>
Dec 01 13:46:10 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="tap35ce63be-f0"/>
Dec 01 13:46:10 user nova-compute[75288]:     </interface>
Dec 01 13:46:10 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:10 user nova-compute[75288]:       <mac address="fa:16:3e:11:c2:d7"/>
Dec 01 13:46:10 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="tap71975ebb-9a"/>
Dec 01 13:46:10 user nova-compute[75288]:     </interface>
Dec 01 13:46:10 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:10 user nova-compute[75288]:       <mac address="fa:16:3e:82:8d:7a"/>
Dec 01 13:46:10 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="tapb2583bac-f8"/>
Dec 01 13:46:10 user nova-compute[75288]:     </interface>
Dec 01 13:46:10 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:10 user nova-compute[75288]:       <mac address="fa:16:3e:03:76:4f"/>
Dec 01 13:46:10 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:10 user nova-compute[75288]:       <target dev="tap965a693f-d1"/>
Dec 01 13:46:10 user nova-compute[75288]:     </interface>
Dec 01 13:46:10 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:46:10 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/8541199a-393b-445d-8945-11fc3f9d0bd9/console.log" append="off"/>
Dec 01 13:46:10 user nova-compute[75288]:     </serial>
Dec 01 13:46:10 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:46:10 user nova-compute[75288]:     <video>
Dec 01 13:46:10 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:10 user nova-compute[75288]:     </video>
Dec 01 13:46:10 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:46:10 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:46:10 user nova-compute[75288]:     </rng>
Dec 01 13:46:10 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:46:10 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:46:10 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:46:10 user nova-compute[75288]:     </memballoon>
Dec 01 13:46:10 user nova-compute[75288]:   </devices>
Dec 01 13:46:10 user nova-compute[75288]: </domain>
Dec 01 13:46:10 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:28,bridge_name='br-int',has_traffic_filtering=True,id=47d653ec-9fa1-4929-bf59-ae48e06726b4,network=Network(4d76c275-d734-4546-9496-9a86957e7231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d653ec-9f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:28,bridge_name='br-int',has_traffic_filtering=True,id=47d653ec-9fa1-4929-bf59-ae48e06726b4,network=Network(4d76c275-d734-4546-9496-9a86957e7231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d653ec-9f') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '103e749e-fac6-5c2e-b48b-188d036a768d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47d653ec-9f, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47d653ec-9f, col_values=(('qos', UUID('4247dc46-5fb6-4b76-a9b6-39320d5f0f2a')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47d653ec-9f, col_values=(('external_ids', {'iface-id': '47d653ec-9fa1-4929-bf59-ae48e06726b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:7e:28', 'vm-uuid': '8541199a-393b-445d-8945-11fc3f9d0bd9'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: INFO os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:7e:28,bridge_name='br-int',has_traffic_filtering=True,id=47d653ec-9fa1-4929-bf59-ae48e06726b4,network=Network(4d76c275-d734-4546-9496-9a86957e7231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d653ec-9f')
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:52:26,bridge_name='br-int',has_traffic_filtering=True,id=bfbfc658-3b20-4753-8473-2a21b94fc8f1,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfbfc658-3b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:52:26,bridge_name='br-int',has_traffic_filtering=True,id=bfbfc658-3b20-4753-8473-2a21b94fc8f1,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfbfc658-3b') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83382df9-13b7-5817-bf7c-f32a877f3589', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfbfc658-3b, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfbfc658-3b, col_values=(('qos', UUID('fc0d1d67-b4b9-4efb-9e27-becd728c6aaa')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfbfc658-3b, col_values=(('external_ids', {'iface-id': 'bfbfc658-3b20-4753-8473-2a21b94fc8f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:52:26', 'vm-uuid': '8541199a-393b-445d-8945-11fc3f9d0bd9'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: INFO os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:52:26,bridge_name='br-int',has_traffic_filtering=True,id=bfbfc658-3b20-4753-8473-2a21b94fc8f1,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfbfc658-3b')
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2d:20,bridge_name='br-int',has_traffic_filtering=True,id=8b872961-dfca-481d-a5f8-716d1d3d26d2,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b872961-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2d:20,bridge_name='br-int',has_traffic_filtering=True,id=8b872961-dfca-481d-a5f8-716d1d3d26d2,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b872961-df') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a02c60e6-c89e-5b2b-9c53-0f079c6671cc', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance spawned successfully.
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b872961-df, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b872961-df, col_values=(('qos', UUID('6bd59d42-5d88-42fa-91c1-f0af2f8cc7bc')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b872961-df, col_values=(('external_ids', {'iface-id': '8b872961-dfca-481d-a5f8-716d1d3d26d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:2d:20', 'vm-uuid': '8541199a-393b-445d-8945-11fc3f9d0bd9'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anbNjTls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:10 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: INFO os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2d:20,bridge_name='br-int',has_traffic_filtering=True,id=8b872961-dfca-481d-a5f8-716d1d3d26d2,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b872961-df')
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=35ce63be-f092-4ded-afef-aeffa88e5eeb,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ce63be-f0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=35ce63be-f092-4ded-afef-aeffa88e5eeb,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ce63be-f0') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:10 user nova-compute[75288]: WARNING nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d for instance with vm_state building and task_state spawning.
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:10 user nova-compute[75288]: WARNING nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f for instance with vm_state building and task_state spawning.
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:10 user nova-compute[75288]: WARNING nova.compute.manager [req-4bd4acae-09cb-49f0-8949-8e7b1dabf661 req-0d355b21-693c-4ff4-ae5f-d796168c28ab service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f for instance with vm_state building and task_state spawning.
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6922d107-b5bb-4e61-acad-b574fe3335b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49747dc6-6a1f-5847-9fd5-0be7841935fd', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:46:10 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81b32ee-5bf2-46f4-94ed-7b9e1d8208bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526] added
Dec 01 13:46:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35ce63be-f0, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35ce63be-f0, col_values=(('qos', UUID('c16fe3df-de40-49d5-a724-8c28db5c4515')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35ce63be-f0, col_values=(('external_ids', {'iface-id': '35ce63be-f092-4ded-afef-aeffa88e5eeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:f5:33', 'vm-uuid': '8541199a-393b-445d-8945-11fc3f9d0bd9'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: INFO nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Took 12.73 seconds to spawn the instance on the hypervisor.
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[508e6feb-e330-4087-9c78-d15a15347e7e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6750657c-7dfa-4869-9439-abbbfb7391d1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anbNjTls {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: INFO os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=35ce63be-f092-4ded-afef-aeffa88e5eeb,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ce63be-f0')
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c2:d7,bridge_name='br-int',has_traffic_filtering=True,id=71975ebb-9a52-41bd-b101-27e8c87b105b,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71975ebb-9a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c2:d7,bridge_name='br-int',has_traffic_filtering=True,id=71975ebb-9a52-41bd-b101-27e8c87b105b,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71975ebb-9a') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42c2896e-7bb9-5a5a-99dd-8394927aa160', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anbNjTls" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[863f4607-82e6-48a4-9932-3b5b23b3a70f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'anbNjTls'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7df4a6b-ea91-4407-b003-6a05cc64ec22]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71975ebb-9a, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71975ebb-9a, col_values=(('qos', UUID('85a05055-99ea-4b8c-b4f6-0289fc708871')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71975ebb-9a, col_values=(('external_ids', {'iface-id': '71975ebb-9a52-41bd-b101-27e8c87b105b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:c2:d7', 'vm-uuid': '8541199a-393b-445d-8945-11fc3f9d0bd9'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05c799b-1fcb-4664-a69a-79fc7c39e878]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:10 user nova-compute[75288]: INFO nova.compute.manager [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Took 88.86 seconds to build instance.
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b9b33b73-1755-4267-8e95-8e5eff5b4205 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 88.971s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: INFO os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c2:d7,bridge_name='br-int',has_traffic_filtering=True,id=71975ebb-9a52-41bd-b101-27e8c87b105b,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71975ebb-9a')
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:7a,bridge_name='br-int',has_traffic_filtering=True,id=b2583bac-f8d6-4dbd-ab70-e6086ea5c02a,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2583bac-f8') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:7a,bridge_name='br-int',has_traffic_filtering=True,id=b2583bac-f8d6-4dbd-ab70-e6086ea5c02a,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2583bac-f8') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e52b267e-3a46-536c-ada1-30893aaec9e6', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80cd944-81f2-40ee-b62c-29d0f6c8d887]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526, portal: 172.16.0.220,3260]
Dec 01 13:46:11 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2583bac-f8, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2583bac-f8, col_values=(('qos', UUID('2f07ea05-d3ce-4a10-a2d1-c1eef98892b9')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2583bac-f8, col_values=(('external_ids', {'iface-id': 'b2583bac-f8d6-4dbd-ab70-e6086ea5c02a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:8d:7a', 'vm-uuid': '8541199a-393b-445d-8945-11fc3f9d0bd9'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[279a7c6d-a8ec-4a72-b443-83b8629add89]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2c8b63-fe13-4fea-b7c3-45be705aa28a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: INFO os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:7a,bridge_name='br-int',has_traffic_filtering=True,id=b2583bac-f8d6-4dbd-ab70-e6086ea5c02a,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2583bac-f8')
Dec 01 13:46:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=965a693f-d1e1-455c-a9b5-645428548617,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965a693f-d1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=965a693f-d1e1-455c-a9b5-645428548617,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965a693f-d1') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f78265f2-5ccc-51ed-9619-cd140dc73e1d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6ebc2a-a38c-4256-8451-d26b02a91308]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anbNjTls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap965a693f-d1, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap965a693f-d1, col_values=(('qos', UUID('7340525b-344e-4ca3-96e0-d317ca353630')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap965a693f-d1, col_values=(('external_ids', {'iface-id': '965a693f-d1e1-455c-a9b5-645428548617', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:76:4f', 'vm-uuid': '8541199a-393b-445d-8945-11fc3f9d0bd9'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: INFO os_vif [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=965a693f-d1e1-455c-a9b5-645428548617,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965a693f-d1')
Dec 01 13:46:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] No VIF found with MAC fa:16:3e:8e:7e:28, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] No VIF found with MAC fa:16:3e:11:c2:d7, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:46:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Using config drive
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Creating config drive at /opt/stack/data/nova/instances/8541199a-393b-445d-8945-11fc3f9d0bd9/disk.config
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8541199a-393b-445d-8945-11fc3f9d0bd9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc39463ox {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8541199a-393b-445d-8945-11fc3f9d0bd9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc39463ox" returned: 0 in 0.071s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23965373032643331', 'path': '/dev/sdl'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965373032643331', 'path': '/dev/sdl'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lazy-loading 'flavor' on Instance uuid b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:46:12 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:12 user nova-compute[75288]:   <source dev="/dev/sdl"/>
Dec 01 13:46:12 user nova-compute[75288]:   <target dev="sdc" bus="scsi"/>
Dec 01 13:46:12 user nova-compute[75288]:   <serial>44b26dbd-adda-4537-a8fe-938641aa3526</serial>
Dec 01 13:46:12 user nova-compute[75288]:   <address type="drive" controller="0" unit="2"/>
Dec 01 13:46:12 user nova-compute[75288]: </disk>
Dec 01 13:46:12 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] No BDM found with device name sda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] No VIF found with MAC fa:16:3e:65:5d:db, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-781c2f81-acdf-4e12-af7b-851aee0be40b tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.999s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:46:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6528740-f062-4dd6-9b99-d41042e2abe4', 'attached_at': '', 'detached_at': '', 'volume_id': 'db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'serial': 'db7963a1-9d17-45e5-b771-6e36ca0cfcf2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMApNOUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '7cd2167e-a242-430e-b9f0-e60095f494e4'}, 'status': 'reserved', 'instance': 'd6528740-f062-4dd6-9b99-d41042e2abe4', 'attached_at': '', 'detached_at': '', 'volume_id': '7cd2167e-a242-430e-b9f0-e60095f494e4', 'serial'} {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-af7c93f6-6c17-4105-9de0-e2d52577333d req-41c43eae-9e2d-471d-8b56-0585ac8bbee1 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af7c93f6-6c17-4105-9de0-e2d52577333d req-41c43eae-9e2d-471d-8b56-0585ac8bbee1 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af7c93f6-6c17-4105-9de0-e2d52577333d req-41c43eae-9e2d-471d-8b56-0585ac8bbee1 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af7c93f6-6c17-4105-9de0-e2d52577333d req-41c43eae-9e2d-471d-8b56-0585ac8bbee1 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-af7c93f6-6c17-4105-9de0-e2d52577333d req-41c43eae-9e2d-471d-8b56-0585ac8bbee1 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-af7c93f6-6c17-4105-9de0-e2d52577333d req-41c43eae-9e2d-471d-8b56-0585ac8bbee1 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-755df01c-71d2-40cd-9cc6-2d547397daaa req-40d59dd6-0732-4e1f-8352-c9eac78e5c16 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-755df01c-71d2-40cd-9cc6-2d547397daaa req-40d59dd6-0732-4e1f-8352-c9eac78e5c16 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-755df01c-71d2-40cd-9cc6-2d547397daaa req-40d59dd6-0732-4e1f-8352-c9eac78e5c16 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-755df01c-71d2-40cd-9cc6-2d547397daaa req-40d59dd6-0732-4e1f-8352-c9eac78e5c16 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-755df01c-71d2-40cd-9cc6-2d547397daaa req-40d59dd6-0732-4e1f-8352-c9eac78e5c16 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-755df01c-71d2-40cd-9cc6-2d547397daaa req-40d59dd6-0732-4e1f-8352-c9eac78e5c16 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-eabe4e2d-3d94-4148-b7d1-88284badaf38 req-49107a59-45fb-46c0-b41c-461fde415615 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-225a9c7c-5390-4db0-8ace-6a67bab5efce req-e32d2639-3e70-42d4-9c2d-0ed4b469e4a7 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-225a9c7c-5390-4db0-8ace-6a67bab5efce req-e32d2639-3e70-42d4-9c2d-0ed4b469e4a7 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-225a9c7c-5390-4db0-8ace-6a67bab5efce req-e32d2639-3e70-42d4-9c2d-0ed4b469e4a7 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-225a9c7c-5390-4db0-8ace-6a67bab5efce req-e32d2639-3e70-42d4-9c2d-0ed4b469e4a7 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-225a9c7c-5390-4db0-8ace-6a67bab5efce req-e32d2639-3e70-42d4-9c2d-0ed4b469e4a7 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-225a9c7c-5390-4db0-8ace-6a67bab5efce req-e32d2639-3e70-42d4-9c2d-0ed4b469e4a7 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-d65bed86-db89-4cea-861e-d5ddfce76c2e req-0433dd8b-e79b-45b0-b114-01b3dde07a6c service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-27f684eb-558e-4326-8f51-93064980071c req-cc97220f-e759-4366-b533-b2f974585a8d service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27f684eb-558e-4326-8f51-93064980071c req-cc97220f-e759-4366-b533-b2f974585a8d service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27f684eb-558e-4326-8f51-93064980071c req-cc97220f-e759-4366-b533-b2f974585a8d service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-27f684eb-558e-4326-8f51-93064980071c req-cc97220f-e759-4366-b533-b2f974585a8d service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-27f684eb-558e-4326-8f51-93064980071c req-cc97220f-e759-4366-b533-b2f974585a8d service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-27f684eb-558e-4326-8f51-93064980071c req-cc97220f-e759-4366-b533-b2f974585a8d service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-e52f4197-fc09-48dc-bc6f-cc35487e2e3e req-39cb4b6a-fec2-4ff7-b9ce-0ad63b3623de service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e52f4197-fc09-48dc-bc6f-cc35487e2e3e req-39cb4b6a-fec2-4ff7-b9ce-0ad63b3623de service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e52f4197-fc09-48dc-bc6f-cc35487e2e3e req-39cb4b6a-fec2-4ff7-b9ce-0ad63b3623de service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e52f4197-fc09-48dc-bc6f-cc35487e2e3e req-39cb4b6a-fec2-4ff7-b9ce-0ad63b3623de service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-e52f4197-fc09-48dc-bc6f-cc35487e2e3e req-39cb4b6a-fec2-4ff7-b9ce-0ad63b3623de service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.compute.manager [req-e52f4197-fc09-48dc-bc6f-cc35487e2e3e req-39cb4b6a-fec2-4ff7-b9ce-0ad63b3623de service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 for instance with vm_state building and task_state spawning.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:18 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:46:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7093MB free_disk=25.436126708984375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance spawned successfully.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:46:18 user nova-compute[75288]: INFO nova.compute.manager [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Detaching volume 44b26dbd-adda-4537-a8fe-938641aa3526
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68e73db-f2cc-4f0d-83dd-59b7b0778d10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:46:18 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b546bb3-158c-4fb9-aec0-b165f4bb9ac9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2] added
Dec 01 13:46:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6083930c-c65b-4be5-aa78-e5d0072a2242]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:18 user nova-compute[75288]: INFO nova.virt.block_device [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Attempting to driver detach volume 44b26dbd-adda-4537-a8fe-938641aa3526 from mountpoint /dev/sdc
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Attempting to detach device sdc from instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:46:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:18 user nova-compute[75288]:   <source dev="/dev/sdl"/>
Dec 01 13:46:18 user nova-compute[75288]:   <target dev="sdc" bus="scsi"/>
Dec 01 13:46:18 user nova-compute[75288]:   <serial>44b26dbd-adda-4537-a8fe-938641aa3526</serial>
Dec 01 13:46:18 user nova-compute[75288]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 01 13:46:18 user nova-compute[75288]: </disk>
Dec 01 13:46:18 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e62f7b-19de-4272-9185-72ddc3953803]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrCxLpDO {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Successfully detached device sdc from instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf from the persistent domain config.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:46:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:18 user nova-compute[75288]:   <source dev="/dev/sdl"/>
Dec 01 13:46:18 user nova-compute[75288]:   <target dev="sdc" bus="scsi"/>
Dec 01 13:46:18 user nova-compute[75288]:   <serial>44b26dbd-adda-4537-a8fe-938641aa3526</serial>
Dec 01 13:46:18 user nova-compute[75288]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 01 13:46:18 user nova-compute[75288]: </disk>
Dec 01 13:46:18 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:46:18 user nova-compute[75288]: INFO nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Took 13.02 seconds to spawn the instance on the hypervisor.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrCxLpDO" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[682bc25a-2e74-475e-889c-eb66d2e5a58d]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrCxLpDO'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2c66ff7f-d0d9-43ff-98a4-bb702780e080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d6528740-f062-4dd6-9b99-d41042e2abe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0ab72540-6333-4a3b-bb5f-411e607bac1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b2803270-b513-474d-8607-619f8582d6a0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 7834a8ee-1c0c-49e1-8b47-70ce3b64c702 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 95dfd223-db19-40c4-ac65-fcba4100e247 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8541199a-393b-445d-8945-11fc3f9d0bd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[357836fc-4dfe-4c7b-9d8d-ca86b4cd0e4f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3030d100-46e6-4857-9c0a-cd7803b67c96]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:18 user nova-compute[75288]: INFO nova.compute.manager [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Took 84.87 seconds to build instance.
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e05af4bd-51c7-4328-b28b-02beb343330e tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 84.964s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f1c63-72b0-42d3-8711-8b763d312a90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260]
Dec 01 13:46:18 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[58eca528-20aa-4685-b00f-2fbc3a2e79fe]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a2c74-3bcf-47bc-ab9d-1cecd39283bc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ca6b96-ae9f-4e61-85ba-247592ea391a]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:46:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '26565313136626162', 'path': '/dev/sdm'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565313136626162', 'path': '/dev/sdm'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lazy-loading 'flavor' on Instance uuid d6528740-f062-4dd6-9b99-d41042e2abe4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 is timed out.
Dec 01 13:46:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Successfully detached device vdb from instance c1ede7e1-e693-455e-ade4-8c1a02418ae0 from the live domain config.
Dec 01 13:46:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CurnkscX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1660dd09-978e-42f8-80f0-5f24f1cf9c28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:46:20 user nova-compute[75288]: No targets found.
Dec 01 13:46:20 user nova-compute[75288]: iSNS:
Dec 01 13:46:20 user nova-compute[75288]: No targets found.
Dec 01 13:46:20 user nova-compute[75288]: STATIC:
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: FIRMWARE:
Dec 01 13:46:20 user nova-compute[75288]: No targets found.
Dec 01 13:46:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:46:20 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:46:20 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e16705-bfff-4ab1-82d2-5464f4dbbe4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7ce5f-95c3-4a00-bc5d-8b6be1664560]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbdc0f5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e29b0c3-2b95-4862-a6cb-f1ce56ea7848]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a912d72e-3a9c-467d-8b46-b4adfbddbaac]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac306da5-353a-4615-a691-522130adc27b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf1a5c-b28b-4eab-bc52-fb90cac25d5f]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3120f0cd-5e34-44f2-9018-e9a815789342]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 15728640 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d598aa-92c0-480e-89e4-227d693f921c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c, portal: 172.16.0.220,3260]
Dec 01 13:46:20 user nova-compute[75288]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0ab72540-6333-4a3b-bb5f-411e607bac1d is timed out.
Dec 01 13:46:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Successfully detached device vdb from instance 0ab72540-6333-4a3b-bb5f-411e607bac1d from the live domain config.
Dec 01 13:46:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMfcKoeu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312e8455-efc1-4eb8-9901-48a0b829bf8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[762b2e40-8b3a-40f0-a23a-a697fe87dfc5]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] <== disconnect_volume: return (400ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.052s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a623b5-2f57-49ef-b67a-e5339dd66106]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:46:20 user nova-compute[75288]: No targets found.
Dec 01 13:46:20 user nova-compute[75288]: iSNS:
Dec 01 13:46:20 user nova-compute[75288]: No targets found.
Dec 01 13:46:20 user nova-compute[75288]: STATIC:
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f
Dec 01 13:46:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:20 user nova-compute[75288]: FIRMWARE:
Dec 01 13:46:20 user nova-compute[75288]: No targets found.
Dec 01 13:46:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:46:20 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:46:20 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17b0d6b-2029-4661-94e5-e3b382b8e67b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1c3e06-24b1-4fe1-aba9-6838501ef586]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc31d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9af060-26f6-450e-9337-77f678c95107]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe553cdd-f1b3-4ed8-980e-0f94f4ee8083]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ddc676-8eaf-4039-aaa9-d0d20e2c28d9]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:46:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b5e802-de3b-4b7d-9f2f-6fb7f792c85f]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c028a92-f5cb-4fb1-8e69-43ffc594616e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 165675008 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9ccd3e-1ddd-4969-8bfc-d3683d7f0e96]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f, portal: 172.16.0.220,3260]
Dec 01 13:46:21 user nova-compute[75288]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbe8adee-c8c4-44ce-93f4-dda7f5ad9a5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d6aaf9-e1cb-4c08-b943-2803a3bc47ac]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] <== disconnect_volume: return (533ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 256901120 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lazy-loading 'flavor' on Instance uuid c1ede7e1-e693-455e-ade4-8c1a02418ae0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 377487360 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-51a6abd0-23be-4365-acff-1a974aa9bcc2 tempest-VolumesAssistedSnapshotsTest-2084988204 tempest-VolumesAssistedSnapshotsTest-2084988204-project-admin] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.608s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lazy-loading 'flavor' on Instance uuid 0ab72540-6333-4a3b-bb5f-411e607bac1d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-817d8433-5583-43c7-9604-cbdad1509958 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.597s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 506462208 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 651165696 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 819986432 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 975175680 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMApNOUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '7cd2167e-a242-430e-b9f0-e60095f494e4'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:24 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e21afc-d812-4130-a127-5cf12ae8b219]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:46:24 user nova-compute[75288]: No targets found.
Dec 01 13:46:24 user nova-compute[75288]: iSNS:
Dec 01 13:46:24 user nova-compute[75288]: No targets found.
Dec 01 13:46:24 user nova-compute[75288]: STATIC:
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526
Dec 01 13:46:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:24 user nova-compute[75288]: FIRMWARE:
Dec 01 13:46:24 user nova-compute[75288]: No targets found.
Dec 01 13:46:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:46:24 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:46:24 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d51495-7fce-4431-ab53-6e84db487bc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9b7d94-a4f9-4609-8952-93cca52fcd35]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98f144c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4'): ({'sdf'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Removing single pathed devices sdf {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e9b92-b86e-442c-9671-5319223e1a5a]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac17358-d054-4f14-afb5-392fcc4e584c]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Flushing IO for device /dev/sdf {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[486783a0-9bdb-47a9-9098-14788d161db7]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15bb36c-5b3f-4922-8097-8b283ab34397]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:46:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2e0016-f03c-4bce-94eb-c407264e6dae]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[38008005-bc0b-4087-8d38-94f930a0c2de]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4, portal: 172.16.0.220,3260]
Dec 01 13:46:25 user nova-compute[75288]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:25 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cd2167e-a242-430e-b9f0-e60095f494e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a03796-6815-4dc3-bfe1-5182bce4df1e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] <== disconnect_volume: return (370ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, 'status': 'reserved', 'instance': 'd6528740-f062-4dd6-9b99-d41042e2abe4', 'attached_at': '', 'detached_at': '', 'volume_id': 'db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'serial'} {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 01 13:46:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] swap_volume: removing Cinder connection for volume 7cd2167e-a242-430e-b9f0-e60095f494e4 {{(pid=75288) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 01 13:46:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] swap_volume: Updating volume 7cd2167e-a242-430e-b9f0-e60095f494e4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HrCxLpDO", "auth_password": "zMoTGFXcjgaiZr", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdm", "volume_id": "db7963a1-9d17-45e5-b771-6e36ca0cfcf2"}, "status": "reserved", "instance": "d6528740-f062-4dd6-9b99-d41042e2abe4", "attached_at": "", "detached_at": "", "volume_id": "db7963a1-9d17-45e5-b771-6e36ca0cfcf2", "serial": "db7963a1-9d17-45e5-b771-6e36ca0cfcf2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'no_device': None, 'attachment_id': '930f25f7-d2a9-4c48-8d2f-df96b1143bae'} {{(pid=75288) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 01 13:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4d05a385-62c5-40c5-803a-7ba8d074e347 tempest-TestVolumeSwap-899737690 tempest-TestVolumeSwap-899737690-project-admin] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.406s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:26 user nova-compute[75288]: INFO nova.compute.manager [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Detaching volume db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:26 user nova-compute[75288]: INFO nova.virt.block_device [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Attempting to driver detach volume db7963a1-9d17-45e5-b771-6e36ca0cfcf2 from mountpoint /dev/vdb
Dec 01 13:46:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Attempting to detach device vdb from instance d6528740-f062-4dd6-9b99-d41042e2abe4 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:46:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:46:26 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:26 user nova-compute[75288]:   <source dev="/dev/sdm"/>
Dec 01 13:46:26 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:46:26 user nova-compute[75288]:   <serial>db7963a1-9d17-45e5-b771-6e36ca0cfcf2</serial>
Dec 01 13:46:26 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:46:26 user nova-compute[75288]: </disk>
Dec 01 13:46:26 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:46:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Successfully detached device vdb from instance d6528740-f062-4dd6-9b99-d41042e2abe4 from the persistent domain config.
Dec 01 13:46:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6528740-f062-4dd6-9b99-d41042e2abe4 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:46:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:46:27 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:46:27 user nova-compute[75288]:   <source dev="/dev/sdm"/>
Dec 01 13:46:27 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:46:27 user nova-compute[75288]:   <serial>db7963a1-9d17-45e5-b771-6e36ca0cfcf2</serial>
Dec 01 13:46:27 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:46:27 user nova-compute[75288]: </disk>
Dec 01 13:46:27 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:46:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6528740-f062-4dd6-9b99-d41042e2abe4 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:46:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 13:46:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:46:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:46:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "b2803270-b513-474d-8607-619f8582d6a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "b2803270-b513-474d-8607-619f8582d6a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "b2803270-b513-474d-8607-619f8582d6a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:29 user nova-compute[75288]: INFO nova.compute.manager [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Terminating instance
Dec 01 13:46:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-6403a1d7-1f9c-4865-990e-b8fb83874425 req-59e484d7-ed49-450d-8882-4afe24971842 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received event network-vif-unplugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6403a1d7-1f9c-4865-990e-b8fb83874425 req-59e484d7-ed49-450d-8882-4afe24971842 service nova] Acquiring lock "b2803270-b513-474d-8607-619f8582d6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6403a1d7-1f9c-4865-990e-b8fb83874425 req-59e484d7-ed49-450d-8882-4afe24971842 service nova] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6403a1d7-1f9c-4865-990e-b8fb83874425 req-59e484d7-ed49-450d-8882-4afe24971842 service nova] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-6403a1d7-1f9c-4865-990e-b8fb83874425 req-59e484d7-ed49-450d-8882-4afe24971842 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] No waiting events found dispatching network-vif-unplugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-6403a1d7-1f9c-4865-990e-b8fb83874425 req-59e484d7-ed49-450d-8882-4afe24971842 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received event network-vif-unplugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:46:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b2803270-b513-474d-8607-619f8582d6a0] Instance destroyed successfully.
Dec 01 13:46:30 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lazy-loading 'resources' on Instance uuid b2803270-b513-474d-8607-619f8582d6a0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1931729115',display_name='tempest-TestVolumeBootPattern-server-1931729115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1931729115',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:45:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-2k0hwweb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:45:21Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=b2803270-b513-474d-8607-619f8582d6a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "address": "fa:16:3e:55:e0:ea", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66cd67d7-77", "ovs_interfaceid": "66cd67d7-779c-4a70-925b-baf5f49bbf20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:ea,bridge_name='br-int',has_traffic_filtering=True,id=66cd67d7-779c-4a70-925b-baf5f49bbf20,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd67d7-77') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_vif [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:ea,bridge_name='br-int',has_traffic_filtering=True,id=66cd67d7-779c-4a70-925b-baf5f49bbf20,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd67d7-77') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66cd67d7-77, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aca9725-ea92-46b7-98f1-d7bc7cebf059) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:30 user nova-compute[75288]: INFO os_vif [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:ea,bridge_name='br-int',has_traffic_filtering=True,id=66cd67d7-779c-4a70-925b-baf5f49bbf20,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66cd67d7-77')
Dec 01 13:46:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOtkAPsF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:30 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.039s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[31539049-ba7b-4095-8c2f-faf1698a450d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:46:30 user nova-compute[75288]: No targets found.
Dec 01 13:46:30 user nova-compute[75288]: iSNS:
Dec 01 13:46:30 user nova-compute[75288]: No targets found.
Dec 01 13:46:30 user nova-compute[75288]: STATIC:
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526
Dec 01 13:46:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:30 user nova-compute[75288]: FIRMWARE:
Dec 01 13:46:30 user nova-compute[75288]: No targets found.
Dec 01 13:46:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:46:30 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:46:30 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc16d96-f189-4ec4-a280-c419da3af061]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2febd86-d6d2-4931-b864-ad918da7c8a1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc4bfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3cc22c-75ca-419b-9da4-a0aba14596df]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15fdf1f-f1fe-47b0-b18a-7df9eaccb9f4]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[325b2787-b864-4120-a1aa-ab927c3ec773]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b922c735-651f-4bd1-9770-708f5a5d4afd]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOba574d9e-1146396ed19aa0e0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ba574d9e', '/dev/disk/by-id/scsi-23131343633393665') {{(pid=86480) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda73252-eb52-41ce-9192-1a50883b74c3]: (4, None) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ad757-a9f0-4f9b-801e-98a9bb3e446b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8725be0-07fa-41f7-b2a4-fdbdaf421c8c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3, portal: 172.16.0.220,3260]
Dec 01 13:46:30 user nova-compute[75288]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca862ab-5700-418a-a598-83f17f6a0fe3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c88305f-34c1-40e7-8ce6-a6794bade09c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== disconnect_volume: return (421ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:46:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Deleting instance files /opt/stack/data/nova/instances/b2803270-b513-474d-8607-619f8582d6a0_del
Dec 01 13:46:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Deletion of /opt/stack/data/nova/instances/b2803270-b513-474d-8607-619f8582d6a0_del complete
Dec 01 13:46:30 user nova-compute[75288]: INFO nova.compute.manager [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Took 1.50 seconds to destroy the instance on the hypervisor.
Dec 01 13:46:30 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: b2803270-b513-474d-8607-619f8582d6a0] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:46:30 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b2803270-b513-474d-8607-619f8582d6a0] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:46:31 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b2803270-b513-474d-8607-619f8582d6a0] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-28d7f8ae-4cf3-43e0-bce0-4f104510f972 req-69cda1d2-b838-489d-9479-0dbd50baaf76 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received event network-vif-deleted-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:31 user nova-compute[75288]: INFO nova.compute.manager [req-28d7f8ae-4cf3-43e0-bce0-4f104510f972 req-69cda1d2-b838-489d-9479-0dbd50baaf76 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Neutron deleted interface 66cd67d7-779c-4a70-925b-baf5f49bbf20; detaching it from the instance and deleting it from the info cache
Dec 01 13:46:31 user nova-compute[75288]: DEBUG nova.network.neutron [req-28d7f8ae-4cf3-43e0-bce0-4f104510f972 req-69cda1d2-b838-489d-9479-0dbd50baaf76 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:31 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: b2803270-b513-474d-8607-619f8582d6a0] Took 0.50 seconds to deallocate network for instance.
Dec 01 13:46:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-28d7f8ae-4cf3-43e0-bce0-4f104510f972 req-69cda1d2-b838-489d-9479-0dbd50baaf76 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Detach interface failed, port_id=66cd67d7-779c-4a70-925b-baf5f49bbf20, reason: Instance b2803270-b513-474d-8607-619f8582d6a0 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:46:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-f2338bce-ae04-4a63-81c8-5fc4ccac3d67 req-26eebfba-d333-4d1d-a217-9b245b051ec6 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received event network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f2338bce-ae04-4a63-81c8-5fc4ccac3d67 req-26eebfba-d333-4d1d-a217-9b245b051ec6 service nova] Acquiring lock "b2803270-b513-474d-8607-619f8582d6a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f2338bce-ae04-4a63-81c8-5fc4ccac3d67 req-26eebfba-d333-4d1d-a217-9b245b051ec6 service nova] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f2338bce-ae04-4a63-81c8-5fc4ccac3d67 req-26eebfba-d333-4d1d-a217-9b245b051ec6 service nova] Lock "b2803270-b513-474d-8607-619f8582d6a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-f2338bce-ae04-4a63-81c8-5fc4ccac3d67 req-26eebfba-d333-4d1d-a217-9b245b051ec6 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] No waiting events found dispatching network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:31 user nova-compute[75288]: WARNING nova.compute.manager [req-f2338bce-ae04-4a63-81c8-5fc4ccac3d67 req-26eebfba-d333-4d1d-a217-9b245b051ec6 service nova] [instance: b2803270-b513-474d-8607-619f8582d6a0] Received unexpected event network-vif-plugged-66cd67d7-779c-4a70-925b-baf5f49bbf20 for instance with vm_state active and task_state deleting.
Dec 01 13:46:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:32 user nova-compute[75288]: INFO nova.compute.manager [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Took 0.91 seconds to detach 1 volumes for instance.
Dec 01 13:46:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: b2803270-b513-474d-8607-619f8582d6a0] Deleting volume: 2ca862ab-5700-418a-a598-83f17f6a0fe3 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 13:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:32 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:46:32 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:32 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Deleted allocations for instance b2803270-b513-474d-8607-619f8582d6a0
Dec 01 13:46:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f315e22a-0149-467a-abaa-998b255a1cda tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "b2803270-b513-474d-8607-619f8582d6a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.701s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf is timed out.
Dec 01 13:46:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Successfully detached device sdc from instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf from the live domain config.
Dec 01 13:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anbNjTls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:39 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[454db177-852d-4651-a72a-947e7b0ac8f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:46:39 user nova-compute[75288]: No targets found.
Dec 01 13:46:39 user nova-compute[75288]: iSNS:
Dec 01 13:46:39 user nova-compute[75288]: No targets found.
Dec 01 13:46:39 user nova-compute[75288]: STATIC:
Dec 01 13:46:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:46:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:39 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:46:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:39 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:46:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:39 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:39 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:46:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:39 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:46:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:39 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:46:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:39 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:39 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526
Dec 01 13:46:39 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:39 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:39 user nova-compute[75288]: FIRMWARE:
Dec 01 13:46:39 user nova-compute[75288]: No targets found.
Dec 01 13:46:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:46:39 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:46:39 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e259c9-f02b-42e7-af80-a7da9c49b2d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5728f2-939b-495e-ad4b-5aaaeb33f98d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e8a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526'): ({'sdl'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Removing single pathed devices sdl {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c498c1b-d95a-467d-87b8-5d142b36d267]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[962d8e72-2089-4c14-aad6-ef5ef9d45bcf]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Flushing IO for device /dev/sdl {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4d4cf2-607c-4cd6-95f3-572048f58bf4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.045s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28ef14b-eab6-4f4e-b282-671a7a073b76]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] SCSI volumes sdl have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eda777e-0a19-417e-8e72-19536fc4e012]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23958ede-4648-4e88-9550-931f796c2c42]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526, portal: 172.16.0.220,3260]
Dec 01 13:46:39 user nova-compute[75288]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44b26dbd-adda-4537-a8fe-938641aa3526 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d1a7e5-d197-4086-9ee4-97fc1ae7389a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] <== disconnect_volume: return (336ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:46:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lazy-loading 'flavor' on Instance uuid b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82a986bb-5dd9-4bdc-b31e-075c8a8e7847 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:41 user nova-compute[75288]: INFO nova.compute.manager [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Terminating instance
Dec 01 13:46:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-180cf0f4-b4b9-4b10-9b1c-5bc39cb6a2e5 req-f9c9ca43-6159-4bc5-b466-c43ec058a458 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received event network-vif-unplugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-180cf0f4-b4b9-4b10-9b1c-5bc39cb6a2e5 req-f9c9ca43-6159-4bc5-b466-c43ec058a458 service nova] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-180cf0f4-b4b9-4b10-9b1c-5bc39cb6a2e5 req-f9c9ca43-6159-4bc5-b466-c43ec058a458 service nova] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-180cf0f4-b4b9-4b10-9b1c-5bc39cb6a2e5 req-f9c9ca43-6159-4bc5-b466-c43ec058a458 service nova] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-180cf0f4-b4b9-4b10-9b1c-5bc39cb6a2e5 req-f9c9ca43-6159-4bc5-b466-c43ec058a458 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] No waiting events found dispatching network-vif-unplugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-180cf0f4-b4b9-4b10-9b1c-5bc39cb6a2e5 req-f9c9ca43-6159-4bc5-b466-c43ec058a458 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received event network-vif-unplugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:46:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Instance destroyed successfully.
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lazy-loading 'resources' on Instance uuid b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "95dfd223-db19-40c4-ac65-fcba4100e247" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "95dfd223-db19-40c4-ac65-fcba4100e247" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1253987832',display_name='tempest-AttachSCSIVolumeTestJSON-server-1253987832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1253987832',id=8,image_ref='dd0a56c9-1627-4588-a44d-c9827de739f2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBMgMWEgyI3n91mzW9epitljo/ZCu+0e4GOhmW+TQkyvAgFzIRCM+X3EeYdBwRCsSgGWlHptA7X/gMgfA+NHFZeU48zknByUkTHtH/8dJi3lHymZ98eSV8j8O7uKHh+OA==',key_name='tempest-keypair-856239091',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e036590e15c44735bce9998cadb23782',ramdisk_id='',reservation_id='r-3wdp0m6n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd0a56c9-1627-4588-a44d-c9827de739f2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1133164368',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1133164368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:43:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71c1bf3a890049c1b32e227cfe787ff0',uuid=b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Converting VIF {"id": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "address": "fa:16:3e:65:5d:db", "network": {"id": "d7834c39-6364-4d8d-9715-bc71fd825fa3", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-159061873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e036590e15c44735bce9998cadb23782", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dda3cf3-23", "ovs_interfaceid": "4dda3cf3-235d-4f36-907d-7bf4620fb7a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:5d:db,bridge_name='br-int',has_traffic_filtering=True,id=4dda3cf3-235d-4f36-907d-7bf4620fb7a8,network=Network(d7834c39-6364-4d8d-9715-bc71fd825fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dda3cf3-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG os_vif [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5d:db,bridge_name='br-int',has_traffic_filtering=True,id=4dda3cf3-235d-4f36-907d-7bf4620fb7a8,network=Network(d7834c39-6364-4d8d-9715-bc71fd825fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dda3cf3-23') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:46:42 user nova-compute[75288]: INFO nova.compute.manager [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Terminating instance
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dda3cf3-23, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3da1ca4f-bbe9-45b7-8f8a-13d71b4529d8) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:42 user nova-compute[75288]: INFO os_vif [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5d:db,bridge_name='br-int',has_traffic_filtering=True,id=4dda3cf3-235d-4f36-907d-7bf4620fb7a8,network=Network(d7834c39-6364-4d8d-9715-bc71fd825fa3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dda3cf3-23')
Dec 01 13:46:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Deleting instance files /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf_del
Dec 01 13:46:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Deletion of /opt/stack/data/nova/instances/b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf_del complete
Dec 01 13:46:42 user nova-compute[75288]: INFO nova.compute.manager [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 01 13:46:42 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Instance destroyed successfully.
Dec 01 13:46:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lazy-loading 'resources' on Instance uuid 95dfd223-db19-40c4-ac65-fcba4100e247 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:44:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-454613805',display_name='tempest-VolumesNegativeTest-instance-454613805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-454613805',id=12,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:45:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2fc75c95ba9494ca2b5aca352bf916b',ramdisk_id='',reservation_id='r-v80c72ly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-521133940',owner_user_name='tempest-VolumesNegativeTest-521133940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:45:00Z,user_data=None,user_id='cfb674e9bacc47eba54fc0e028ed1c77',uuid=95dfd223-db19-40c4-ac65-fcba4100e247,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Converting VIF {"id": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "address": "fa:16:3e:2e:36:1a", "network": {"id": "dbd18687-1e59-4379-a7d3-ccddadafebd9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e8c19a51c432440b8289ab0896f37cc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ff400a-19", "ovs_interfaceid": "b7ff400a-19a7-4da8-88e4-7c41d83690dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:36:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7ff400a-19a7-4da8-88e4-7c41d83690dc,network=Network(dbd18687-1e59-4379-a7d3-ccddadafebd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ff400a-19') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG os_vif [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:36:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7ff400a-19a7-4da8-88e4-7c41d83690dc,network=Network(dbd18687-1e59-4379-a7d3-ccddadafebd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ff400a-19') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7ff400a-19, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3232cd3-f4e3-415e-8842-164207a718a9) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:43 user nova-compute[75288]: INFO os_vif [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:36:1a,bridge_name='br-int',has_traffic_filtering=True,id=b7ff400a-19a7-4da8-88e4-7c41d83690dc,network=Network(dbd18687-1e59-4379-a7d3-ccddadafebd9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ff400a-19')
Dec 01 13:46:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Deleting instance files /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247_del
Dec 01 13:46:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Deletion of /opt/stack/data/nova/instances/95dfd223-db19-40c4-ac65-fcba4100e247_del complete
Dec 01 13:46:43 user nova-compute[75288]: INFO nova.compute.manager [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 01 13:46:43 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:43 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Took 1.22 seconds to deallocate network for instance.
Dec 01 13:46:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-9f600744-c67b-424a-b66e-3a218c0a3a4f req-a7a7fd8a-f2c0-4349-b47b-831300fd1092 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received event network-vif-deleted-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received event network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Acquiring lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] No waiting events found dispatching network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:44 user nova-compute[75288]: WARNING nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf] Received unexpected event network-vif-plugged-4dda3cf3-235d-4f36-907d-7bf4620fb7a8 for instance with vm_state deleted and task_state None.
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received event network-vif-unplugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Acquiring lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] No waiting events found dispatching network-vif-unplugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received event network-vif-unplugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received event network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Acquiring lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] Lock "95dfd223-db19-40c4-ac65-fcba4100e247-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] No waiting events found dispatching network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:44 user nova-compute[75288]: WARNING nova.compute.manager [req-72c481e5-5861-4503-9cb8-2a88d254b845 req-690d2792-3c47-4672-97bb-3126c953ad92 service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received unexpected event network-vif-plugged-b7ff400a-19a7-4da8-88e4-7c41d83690dc for instance with vm_state active and task_state deleting.
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:44 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Deleted allocations for instance b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:44 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Took 0.93 seconds to deallocate network for instance.
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-fd1114ac-de0c-49fc-92af-3fa0db721a7f req-3b57dd35-d3c9-43ea-9a50-8090fb80b40c service nova] [instance: 95dfd223-db19-40c4-ac65-fcba4100e247] Received event network-vif-deleted-b7ff400a-19a7-4da8-88e4-7c41d83690dc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6c44f5e1-ddb5-4547-8c17-87a872de0324 tempest-AttachSCSIVolumeTestJSON-1133164368 tempest-AttachSCSIVolumeTestJSON-1133164368-project-member] Lock "b6046a0b-ea6e-4d5f-a5ed-1cb56946ccdf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.775s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:46:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:44 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Deleted allocations for instance 95dfd223-db19-40c4-ac65-fcba4100e247
Dec 01 13:46:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ca67bf1c-0d60-48bd-af16-e74a10e2a729 tempest-VolumesNegativeTest-521133940 tempest-VolumesNegativeTest-521133940-project-member] Lock "95dfd223-db19-40c4-ac65-fcba4100e247" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.501s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6528740-f062-4dd6-9b99-d41042e2abe4 is timed out.
Dec 01 13:46:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Successfully detached device vdb from instance d6528740-f062-4dd6-9b99-d41042e2abe4 from the live domain config.
Dec 01 13:46:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrCxLpDO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'db7963a1-9d17-45e5-b771-6e36ca0cfcf2'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:46:47 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1137a294-92cb-4eaa-ba44-84db7495fd86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:46:47 user nova-compute[75288]: No targets found.
Dec 01 13:46:47 user nova-compute[75288]: iSNS:
Dec 01 13:46:47 user nova-compute[75288]: No targets found.
Dec 01 13:46:47 user nova-compute[75288]: STATIC:
Dec 01 13:46:47 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:46:47 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:47 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:47 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:46:47 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:47 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:47 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:46:47 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:47 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:47 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2
Dec 01 13:46:47 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:47 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:47 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:46:47 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:47 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:47 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:46:47 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:47 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:47 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:46:47 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:46:47 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:46:47 user nova-compute[75288]: FIRMWARE:
Dec 01 13:46:47 user nova-compute[75288]: No targets found.
Dec 01 13:46:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:46:47 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:46:47 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[af512a6a-23ac-45be-adb0-58042a797308]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee1d89-4edb-4aef-b1fd-9c6c27edd899]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:46:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc27ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2'): ({'sdm'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Removing single pathed devices sdm {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b03c614-874a-4832-862e-200cc322bd6c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad554d-23f0-4bb4-9b56-849d52172f56]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Flushing IO for device /dev/sdm {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.012s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d5d8f-5f7c-4940-b177-7a297b756ff1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.037s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ef49c-ff7d-40ea-8ea5-2cb1175cd5fa]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] SCSI volumes sdm have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ed767e-86d3-4110-a7dd-ae8170fb45ef]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df17ec6-fbdc-44da-a14b-a865b32d6159]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260]
Dec 01 13:46:47 user nova-compute[75288]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2, portal: 172.16.0.220,3260] successful.
Dec 01 13:46:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7963a1-9d17-45e5-b771-6e36ca0cfcf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd733d81-3c1f-496c-b14d-fbcaf2f3524a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] <== disconnect_volume: return (307ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:46:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:46:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lazy-loading 'flavor' on Instance uuid d6528740-f062-4dd6-9b99-d41042e2abe4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8f877d9-1cb0-4857-b69e-d3e04de0f203 tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.957s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "2aba04bd-402b-4a52-8394-3a59339a8f9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:46:51 user nova-compute[75288]: INFO nova.compute.claims [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Claim successful on node user
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.policy [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b14b041e05644358b3365ca675a93cfe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d820dd1ad9d42229c9537044fd32cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:46:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Creating image(s)
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "/opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "/opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "/opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Successfully created port: bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk 1073741824" returned: 0 in 0.054s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Cannot resize image /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Ensure instance console log exists: /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Successfully updated port: bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "refresh_cache-2aba04bd-402b-4a52-8394-3a59339a8f9b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquired lock "refresh_cache-2aba04bd-402b-4a52-8394-3a59339a8f9b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:46:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-73e25d4b-9278-4944-89ae-e906efa689cd req-d215184b-cda6-48e7-967d-c119b51aad18 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received event network-changed-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-73e25d4b-9278-4944-89ae-e906efa689cd req-d215184b-cda6-48e7-967d-c119b51aad18 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Refreshing instance network info cache due to event network-changed-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73e25d4b-9278-4944-89ae-e906efa689cd req-d215184b-cda6-48e7-967d-c119b51aad18 service nova] Acquiring lock "refresh_cache-2aba04bd-402b-4a52-8394-3a59339a8f9b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Updating instance_info_cache with network_info: [{"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Releasing lock "refresh_cache-2aba04bd-402b-4a52-8394-3a59339a8f9b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Instance network_info: |[{"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73e25d4b-9278-4944-89ae-e906efa689cd req-d215184b-cda6-48e7-967d-c119b51aad18 service nova] Acquired lock "refresh_cache-2aba04bd-402b-4a52-8394-3a59339a8f9b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-73e25d4b-9278-4944-89ae-e906efa689cd req-d215184b-cda6-48e7-967d-c119b51aad18 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Refreshing network info cache for port bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Start _get_guest_xml network_info=[{"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:46:53 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:46:53 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-341024266',display_name='tempest-VolumesAdminNegativeTest-server-341024266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-341024266',id=14,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d820dd1ad9d42229c9537044fd32cbb',ramdisk_id='',reservation_id='r-jw2btvge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1728786286',owner_user_name='tempest-VolumesAdminNegativeTest-1728786286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:46:52Z,user_data=None,user_id='b14b041e05644358b3365ca675a93cfe',uuid=2aba04bd-402b-4a52-8394-3a59339a8f9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converting VIF {"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:59,bridge_name='br-int',has_traffic_filtering=True,id=bd573751-6be1-4d1a-a4df-ce6d8ceb6edc,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd573751-6b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lazy-loading 'pci_devices' on Instance uuid 2aba04bd-402b-4a52-8394-3a59339a8f9b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:46:53 user nova-compute[75288]:   <uuid>2aba04bd-402b-4a52-8394-3a59339a8f9b</uuid>
Dec 01 13:46:53 user nova-compute[75288]:   <name>instance-0000000e</name>
Dec 01 13:46:53 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:46:53 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:46:53 user nova-compute[75288]:   <metadata>
Dec 01 13:46:53 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:46:53 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:46:53 user nova-compute[75288]:       <nova:name>tempest-VolumesAdminNegativeTest-server-341024266</nova:name>
Dec 01 13:46:53 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:46:53</nova:creationTime>
Dec 01 13:46:53 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:46:53 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:46:53 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:46:53 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:46:53 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:46:53 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:46:53 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:46:53 user nova-compute[75288]:       <nova:owner>
Dec 01 13:46:53 user nova-compute[75288]:         <nova:user uuid="b14b041e05644358b3365ca675a93cfe">tempest-VolumesAdminNegativeTest-1728786286-project-member</nova:user>
Dec 01 13:46:53 user nova-compute[75288]:         <nova:project uuid="2d820dd1ad9d42229c9537044fd32cbb">tempest-VolumesAdminNegativeTest-1728786286</nova:project>
Dec 01 13:46:53 user nova-compute[75288]:       </nova:owner>
Dec 01 13:46:53 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:46:53 user nova-compute[75288]:       <nova:ports>
Dec 01 13:46:53 user nova-compute[75288]:         <nova:port uuid="bd573751-6be1-4d1a-a4df-ce6d8ceb6edc">
Dec 01 13:46:53 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 13:46:53 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:53 user nova-compute[75288]:       </nova:ports>
Dec 01 13:46:53 user nova-compute[75288]:     </nova:instance>
Dec 01 13:46:53 user nova-compute[75288]:   </metadata>
Dec 01 13:46:53 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:46:53 user nova-compute[75288]:     <system>
Dec 01 13:46:53 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:46:53 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:46:53 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:46:53 user nova-compute[75288]:       <entry name="serial">2aba04bd-402b-4a52-8394-3a59339a8f9b</entry>
Dec 01 13:46:53 user nova-compute[75288]:       <entry name="uuid">2aba04bd-402b-4a52-8394-3a59339a8f9b</entry>
Dec 01 13:46:53 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:46:53 user nova-compute[75288]:     </system>
Dec 01 13:46:53 user nova-compute[75288]:   </sysinfo>
Dec 01 13:46:53 user nova-compute[75288]:   <os>
Dec 01 13:46:53 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:46:53 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:46:53 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:46:53 user nova-compute[75288]:   </os>
Dec 01 13:46:53 user nova-compute[75288]:   <features>
Dec 01 13:46:53 user nova-compute[75288]:     <acpi/>
Dec 01 13:46:53 user nova-compute[75288]:     <apic/>
Dec 01 13:46:53 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:46:53 user nova-compute[75288]:   </features>
Dec 01 13:46:53 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:46:53 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:46:53 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:46:53 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:46:53 user nova-compute[75288]:   </clock>
Dec 01 13:46:53 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:46:53 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:46:53 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:46:53 user nova-compute[75288]:   </cpu>
Dec 01 13:46:53 user nova-compute[75288]:   <devices>
Dec 01 13:46:53 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:46:53 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:46:53 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk"/>
Dec 01 13:46:53 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:46:53 user nova-compute[75288]:     </disk>
Dec 01 13:46:53 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:53 user nova-compute[75288]:       <mac address="fa:16:3e:9b:19:59"/>
Dec 01 13:46:53 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:53 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:53 user nova-compute[75288]:       <target dev="tapbd573751-6b"/>
Dec 01 13:46:53 user nova-compute[75288]:     </interface>
Dec 01 13:46:53 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:46:53 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/console.log" append="off"/>
Dec 01 13:46:53 user nova-compute[75288]:     </serial>
Dec 01 13:46:53 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:46:53 user nova-compute[75288]:     <video>
Dec 01 13:46:53 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:53 user nova-compute[75288]:     </video>
Dec 01 13:46:53 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:46:53 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:46:53 user nova-compute[75288]:     </rng>
Dec 01 13:46:53 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:46:53 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:46:53 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:46:53 user nova-compute[75288]:     </memballoon>
Dec 01 13:46:53 user nova-compute[75288]:   </devices>
Dec 01 13:46:53 user nova-compute[75288]: </domain>
Dec 01 13:46:53 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-341024266',display_name='tempest-VolumesAdminNegativeTest-server-341024266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-341024266',id=14,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d820dd1ad9d42229c9537044fd32cbb',ramdisk_id='',reservation_id='r-jw2btvge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1728786286',owner_user_name='tempest-VolumesAdminNegativeTest-1728786286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:46:52Z,user_data=None,user_id='b14b041e05644358b3365ca675a93cfe',uuid=2aba04bd-402b-4a52-8394-3a59339a8f9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converting VIF {"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:59,bridge_name='br-int',has_traffic_filtering=True,id=bd573751-6be1-4d1a-a4df-ce6d8ceb6edc,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd573751-6b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG os_vif [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:59,bridge_name='br-int',has_traffic_filtering=True,id=bd573751-6be1-4d1a-a4df-ce6d8ceb6edc,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd573751-6b') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e8d6224-ce06-5a8d-b33a-1fdff1b054cd', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd573751-6b, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd573751-6b, col_values=(('qos', UUID('60e7784b-c7a0-4535-a972-2efbfc6e1f67')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd573751-6b, col_values=(('external_ids', {'iface-id': 'bd573751-6be1-4d1a-a4df-ce6d8ceb6edc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:19:59', 'vm-uuid': '2aba04bd-402b-4a52-8394-3a59339a8f9b'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:53 user nova-compute[75288]: INFO os_vif [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:59,bridge_name='br-int',has_traffic_filtering=True,id=bd573751-6be1-4d1a-a4df-ce6d8ceb6edc,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd573751-6b')
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] No VIF found with MAC fa:16:3e:9b:19:59, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-73e25d4b-9278-4944-89ae-e906efa689cd req-d215184b-cda6-48e7-967d-c119b51aad18 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Updated VIF entry in instance network info cache for port bd573751-6be1-4d1a-a4df-ce6d8ceb6edc. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-73e25d4b-9278-4944-89ae-e906efa689cd req-d215184b-cda6-48e7-967d-c119b51aad18 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Updating instance_info_cache with network_info: [{"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-73e25d4b-9278-4944-89ae-e906efa689cd req-d215184b-cda6-48e7-967d-c119b51aad18 service nova] Releasing lock "refresh_cache-2aba04bd-402b-4a52-8394-3a59339a8f9b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:54 user nova-compute[75288]: INFO nova.compute.manager [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Terminating instance
Dec 01 13:46:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-0c5756d2-bba7-4b7c-a35c-dcac500e79de req-65452baf-08d9-4617-9468-8ba185463e8a service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received event network-vif-unplugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c5756d2-bba7-4b7c-a35c-dcac500e79de req-65452baf-08d9-4617-9468-8ba185463e8a service nova] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c5756d2-bba7-4b7c-a35c-dcac500e79de req-65452baf-08d9-4617-9468-8ba185463e8a service nova] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c5756d2-bba7-4b7c-a35c-dcac500e79de req-65452baf-08d9-4617-9468-8ba185463e8a service nova] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-0c5756d2-bba7-4b7c-a35c-dcac500e79de req-65452baf-08d9-4617-9468-8ba185463e8a service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] No waiting events found dispatching network-vif-unplugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-0c5756d2-bba7-4b7c-a35c-dcac500e79de req-65452baf-08d9-4617-9468-8ba185463e8a service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received event network-vif-unplugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-8262f2f2-c838-4f26-ae6e-8527da4bfd33 req-5e783556-e16e-44c3-ab95-b20127e80caf service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received event network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8262f2f2-c838-4f26-ae6e-8527da4bfd33 req-5e783556-e16e-44c3-ab95-b20127e80caf service nova] Acquiring lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8262f2f2-c838-4f26-ae6e-8527da4bfd33 req-5e783556-e16e-44c3-ab95-b20127e80caf service nova] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8262f2f2-c838-4f26-ae6e-8527da4bfd33 req-5e783556-e16e-44c3-ab95-b20127e80caf service nova] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-8262f2f2-c838-4f26-ae6e-8527da4bfd33 req-5e783556-e16e-44c3-ab95-b20127e80caf service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] No waiting events found dispatching network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:55 user nova-compute[75288]: WARNING nova.compute.manager [req-8262f2f2-c838-4f26-ae6e-8527da4bfd33 req-5e783556-e16e-44c3-ab95-b20127e80caf service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received unexpected event network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc for instance with vm_state building and task_state spawning.
Dec 01 13:46:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Instance destroyed successfully.
Dec 01 13:46:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lazy-loading 'resources' on Instance uuid c1ede7e1-e693-455e-ade4-8c1a02418ae0 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1422221354',display_name='tempest-VolumesAssistedSnapshotsTest-server-1422221354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1422221354',id=9,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6jrx21bYaRECPGAxE38STS2d/ztvEIqK7shIZXBtBETQqCoijonjEPv31xBg5Anukl5OzeWpTkQOeK7fiVWZUEfkyfqfRXAdWPxghAnM+RfAajqRgANdKGkLuPH/lGEA==',key_name='tempest-keypair-2136318084',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d37ed5061104f40bbe5b7f54c9eff85',ramdisk_id='',reservation_id='r-62dgvvnb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-118519178',owner_user_name='tempest-VolumesAssistedSnapshotsTest-118519178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5f09a6c46ad44f8bcb1ebbb07314ba1',uuid=c1ede7e1-e693-455e-ade4-8c1a02418ae0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Converting VIF {"id": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "address": "fa:16:3e:0e:83:37", "network": {"id": "408df822-8582-466a-8c70-5681013da590", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1386350859-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d37ed5061104f40bbe5b7f54c9eff85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf3a6053-9e", "ovs_interfaceid": "cf3a6053-9edf-4e08-9a42-b4227eae8e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:83:37,bridge_name='br-int',has_traffic_filtering=True,id=cf3a6053-9edf-4e08-9a42-b4227eae8e1b,network=Network(408df822-8582-466a-8c70-5681013da590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a6053-9e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG os_vif [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:83:37,bridge_name='br-int',has_traffic_filtering=True,id=cf3a6053-9edf-4e08-9a42-b4227eae8e1b,network=Network(408df822-8582-466a-8c70-5681013da590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a6053-9e') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf3a6053-9e, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0196a9f5-c276-4b8e-9309-1e70259fb8f4) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:55 user nova-compute[75288]: INFO os_vif [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:83:37,bridge_name='br-int',has_traffic_filtering=True,id=cf3a6053-9edf-4e08-9a42-b4227eae8e1b,network=Network(408df822-8582-466a-8c70-5681013da590),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf3a6053-9e')
Dec 01 13:46:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Deleting instance files /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0_del
Dec 01 13:46:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Deletion of /opt/stack/data/nova/instances/c1ede7e1-e693-455e-ade4-8c1a02418ae0_del complete
Dec 01 13:46:55 user nova-compute[75288]: INFO nova.compute.manager [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Took 1.47 seconds to destroy the instance on the hypervisor.
Dec 01 13:46:55 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:46:55 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:56 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Took 0.87 seconds to deallocate network for instance.
Dec 01 13:46:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-0f69c5db-b8a9-46e8-9466-ff532811068e req-772228f2-890f-47a2-b455-1cfb25af11dd service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received event network-vif-deleted-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-a1a33e87-a1bc-43c5-ab4f-6cebef82552e req-ec1183f8-2891-4d27-bea5-5c801e528c85 service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received event network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a1a33e87-a1bc-43c5-ab4f-6cebef82552e req-ec1183f8-2891-4d27-bea5-5c801e528c85 service nova] Acquiring lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a1a33e87-a1bc-43c5-ab4f-6cebef82552e req-ec1183f8-2891-4d27-bea5-5c801e528c85 service nova] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a1a33e87-a1bc-43c5-ab4f-6cebef82552e req-ec1183f8-2891-4d27-bea5-5c801e528c85 service nova] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-a1a33e87-a1bc-43c5-ab4f-6cebef82552e req-ec1183f8-2891-4d27-bea5-5c801e528c85 service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] No waiting events found dispatching network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:56 user nova-compute[75288]: WARNING nova.compute.manager [req-a1a33e87-a1bc-43c5-ab4f-6cebef82552e req-ec1183f8-2891-4d27-bea5-5c801e528c85 service nova] [instance: c1ede7e1-e693-455e-ade4-8c1a02418ae0] Received unexpected event network-vif-plugged-cf3a6053-9edf-4e08-9a42-b4227eae8e1b for instance with vm_state active and task_state deleting.
Dec 01 13:46:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:46:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.205s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:46:57 user nova-compute[75288]: INFO nova.compute.claims [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Claim successful on node user
Dec 01 13:46:57 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Deleted allocations for instance c1ede7e1-e693-455e-ade4-8c1a02418ae0
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62d7944-2221-4dbf-a61f-187489dd9794 tempest-VolumesAssistedSnapshotsTest-118519178 tempest-VolumesAssistedSnapshotsTest-118519178-project-member] Lock "c1ede7e1-e693-455e-ade4-8c1a02418ae0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.060s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-19ca7bb3-a357-459f-9134-9db2803fd0f9 req-3cff9ebf-abf1-4677-a54e-8ed93d89579d service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received event network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-19ca7bb3-a357-459f-9134-9db2803fd0f9 req-3cff9ebf-abf1-4677-a54e-8ed93d89579d service nova] Acquiring lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-19ca7bb3-a357-459f-9134-9db2803fd0f9 req-3cff9ebf-abf1-4677-a54e-8ed93d89579d service nova] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-19ca7bb3-a357-459f-9134-9db2803fd0f9 req-3cff9ebf-abf1-4677-a54e-8ed93d89579d service nova] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-19ca7bb3-a357-459f-9134-9db2803fd0f9 req-3cff9ebf-abf1-4677-a54e-8ed93d89579d service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] No waiting events found dispatching network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:46:57 user nova-compute[75288]: WARNING nova.compute.manager [req-19ca7bb3-a357-459f-9134-9db2803fd0f9 req-3cff9ebf-abf1-4677-a54e-8ed93d89579d service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received unexpected event network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc for instance with vm_state building and task_state spawning.
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:46:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Instance spawned successfully.
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:46:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:46:57 user nova-compute[75288]: INFO nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Took 5.88 seconds to spawn the instance on the hypervisor.
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.policy [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8b600efb9d47b6991cbde8b34b9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fa93e7dad94355a81ee3193a26d19a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:46:57 user nova-compute[75288]: INFO nova.compute.manager [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Took 6.70 seconds to build instance.
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1c0ee15d-d007-45a1-abdf-733a039a2a0d tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.798s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:46:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Creating image(s)
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk 1073741824" returned: 0 in 0.078s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Successfully created port: 333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Cannot resize image /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Ensure instance console log exists: /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:46:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Successfully updated port: 333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquired lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-831d7586-c85a-4007-8b56-f55734bfdf5b req-22db1b68-4fa9-4af2-8b9c-70455b540836 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-changed-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-831d7586-c85a-4007-8b56-f55734bfdf5b req-22db1b68-4fa9-4af2-8b9c-70455b540836 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Refreshing instance network info cache due to event network-changed-333c0000-ff58-4863-9d8e-0ddb10c68fd4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-831d7586-c85a-4007-8b56-f55734bfdf5b req-22db1b68-4fa9-4af2-8b9c-70455b540836 service nova] Acquiring lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updating instance_info_cache with network_info: [{"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Releasing lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance network_info: |[{"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-831d7586-c85a-4007-8b56-f55734bfdf5b req-22db1b68-4fa9-4af2-8b9c-70455b540836 service nova] Acquired lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.neutron [req-831d7586-c85a-4007-8b56-f55734bfdf5b req-22db1b68-4fa9-4af2-8b9c-70455b540836 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Refreshing network info cache for port 333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Start _get_guest_xml network_info=[{"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:46:59 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:46:59 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-40793095',display_name='tempest-tempest.common.compute-instance-40793095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-40793095',id=15,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5j1QWrZjfkoFlcpgSGfDNOjKE6v1FOAOHJWIKiXDL1au5SABv0JByEfrULtJD5kv5INUeHAkqa5529ZSiBuaqcnIji8lw7kE1ULzkmLZbtPCUiT9YmupohdcUvXOM8jA==',key_name='tempest-keypair-546973573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-s007j6g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=64e25352-1ed2-4eda-a376-cb722f0b779f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'pci_devices' on Instance uuid 64e25352-1ed2-4eda-a376-cb722f0b779f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:46:59 user nova-compute[75288]:   <uuid>64e25352-1ed2-4eda-a376-cb722f0b779f</uuid>
Dec 01 13:46:59 user nova-compute[75288]:   <name>instance-0000000f</name>
Dec 01 13:46:59 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:46:59 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:46:59 user nova-compute[75288]:   <metadata>
Dec 01 13:46:59 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:46:59 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:46:59 user nova-compute[75288]:       <nova:name>tempest-tempest.common.compute-instance-40793095</nova:name>
Dec 01 13:46:59 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:46:59</nova:creationTime>
Dec 01 13:46:59 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:46:59 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:46:59 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:46:59 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:46:59 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:46:59 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:46:59 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:46:59 user nova-compute[75288]:       <nova:owner>
Dec 01 13:46:59 user nova-compute[75288]:         <nova:user uuid="5a8b600efb9d47b6991cbde8b34b9a1f">tempest-ServerActionsTestOtherA-1200563250-project-member</nova:user>
Dec 01 13:46:59 user nova-compute[75288]:         <nova:project uuid="85fa93e7dad94355a81ee3193a26d19a">tempest-ServerActionsTestOtherA-1200563250</nova:project>
Dec 01 13:46:59 user nova-compute[75288]:       </nova:owner>
Dec 01 13:46:59 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:46:59 user nova-compute[75288]:       <nova:ports>
Dec 01 13:46:59 user nova-compute[75288]:         <nova:port uuid="333c0000-ff58-4863-9d8e-0ddb10c68fd4">
Dec 01 13:46:59 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 13:46:59 user nova-compute[75288]:         </nova:port>
Dec 01 13:46:59 user nova-compute[75288]:       </nova:ports>
Dec 01 13:46:59 user nova-compute[75288]:     </nova:instance>
Dec 01 13:46:59 user nova-compute[75288]:   </metadata>
Dec 01 13:46:59 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:46:59 user nova-compute[75288]:     <system>
Dec 01 13:46:59 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:46:59 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:46:59 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:46:59 user nova-compute[75288]:       <entry name="serial">64e25352-1ed2-4eda-a376-cb722f0b779f</entry>
Dec 01 13:46:59 user nova-compute[75288]:       <entry name="uuid">64e25352-1ed2-4eda-a376-cb722f0b779f</entry>
Dec 01 13:46:59 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:46:59 user nova-compute[75288]:     </system>
Dec 01 13:46:59 user nova-compute[75288]:   </sysinfo>
Dec 01 13:46:59 user nova-compute[75288]:   <os>
Dec 01 13:46:59 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:46:59 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:46:59 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:46:59 user nova-compute[75288]:   </os>
Dec 01 13:46:59 user nova-compute[75288]:   <features>
Dec 01 13:46:59 user nova-compute[75288]:     <acpi/>
Dec 01 13:46:59 user nova-compute[75288]:     <apic/>
Dec 01 13:46:59 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:46:59 user nova-compute[75288]:   </features>
Dec 01 13:46:59 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:46:59 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:46:59 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:46:59 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:46:59 user nova-compute[75288]:   </clock>
Dec 01 13:46:59 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:46:59 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:46:59 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:46:59 user nova-compute[75288]:   </cpu>
Dec 01 13:46:59 user nova-compute[75288]:   <devices>
Dec 01 13:46:59 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:46:59 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:46:59 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk"/>
Dec 01 13:46:59 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:46:59 user nova-compute[75288]:     </disk>
Dec 01 13:46:59 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:46:59 user nova-compute[75288]:       <mac address="fa:16:3e:80:8b:d4"/>
Dec 01 13:46:59 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:59 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:46:59 user nova-compute[75288]:       <target dev="tap333c0000-ff"/>
Dec 01 13:46:59 user nova-compute[75288]:     </interface>
Dec 01 13:46:59 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:46:59 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/console.log" append="off"/>
Dec 01 13:46:59 user nova-compute[75288]:     </serial>
Dec 01 13:46:59 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:46:59 user nova-compute[75288]:     <video>
Dec 01 13:46:59 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:46:59 user nova-compute[75288]:     </video>
Dec 01 13:46:59 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:46:59 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:46:59 user nova-compute[75288]:     </rng>
Dec 01 13:46:59 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:46:59 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:46:59 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:46:59 user nova-compute[75288]:     </memballoon>
Dec 01 13:46:59 user nova-compute[75288]:   </devices>
Dec 01 13:46:59 user nova-compute[75288]: </domain>
Dec 01 13:46:59 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-40793095',display_name='tempest-tempest.common.compute-instance-40793095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-40793095',id=15,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5j1QWrZjfkoFlcpgSGfDNOjKE6v1FOAOHJWIKiXDL1au5SABv0JByEfrULtJD5kv5INUeHAkqa5529ZSiBuaqcnIji8lw7kE1ULzkmLZbtPCUiT9YmupohdcUvXOM8jA==',key_name='tempest-keypair-546973573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-s007j6g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=64e25352-1ed2-4eda-a376-cb722f0b779f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG os_vif [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ff1ce45-c246-56a8-88b4-4a1a9db12318', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap333c0000-ff, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap333c0000-ff, col_values=(('qos', UUID('ed5d2c7c-5f1a-47ed-9a62-4b7d81fa803a')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap333c0000-ff, col_values=(('external_ids', {'iface-id': '333c0000-ff58-4863-9d8e-0ddb10c68fd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:8b:d4', 'vm-uuid': '64e25352-1ed2-4eda-a376-cb722f0b779f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:46:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:46:59 user nova-compute[75288]: INFO os_vif [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff')
Dec 01 13:47:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No VIF found with MAC fa:16:3e:80:8b:d4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:47:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-831d7586-c85a-4007-8b56-f55734bfdf5b req-22db1b68-4fa9-4af2-8b9c-70455b540836 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updated VIF entry in instance network info cache for port 333c0000-ff58-4863-9d8e-0ddb10c68fd4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:47:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-831d7586-c85a-4007-8b56-f55734bfdf5b req-22db1b68-4fa9-4af2-8b9c-70455b540836 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updating instance_info_cache with network_info: [{"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-831d7586-c85a-4007-8b56-f55734bfdf5b req-22db1b68-4fa9-4af2-8b9c-70455b540836 service nova] Releasing lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'flavor' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:01 user nova-compute[75288]: INFO nova.compute.manager [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Attaching volume 8b89ddf0-7d91-4798-a7a7-b8bae33bf175 to /dev/vdb
Dec 01 13:47:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-c5af8a46-ae2a-462d-b233-853a1c6a5756 req-ab7619fd-6f0b-4d02-822f-e3995c060c25 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5af8a46-ae2a-462d-b233-853a1c6a5756 req-ab7619fd-6f0b-4d02-822f-e3995c060c25 service nova] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5af8a46-ae2a-462d-b233-853a1c6a5756 req-ab7619fd-6f0b-4d02-822f-e3995c060c25 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c5af8a46-ae2a-462d-b233-853a1c6a5756 req-ab7619fd-6f0b-4d02-822f-e3995c060c25 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-c5af8a46-ae2a-462d-b233-853a1c6a5756 req-ab7619fd-6f0b-4d02-822f-e3995c060c25 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] No waiting events found dispatching network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:01 user nova-compute[75288]: WARNING nova.compute.manager [req-c5af8a46-ae2a-462d-b233-853a1c6a5756 req-ab7619fd-6f0b-4d02-822f-e3995c060c25 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received unexpected event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 for instance with vm_state building and task_state spawning.
Dec 01 13:47:01 user nova-compute[75288]: DEBUG os_brick.utils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3e82ab-a44c-4789-9fdb-7ff24962b24d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a3e20f-84c7-41e6-b686-f7f5ed6a7bd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be91ad52-8949-4fba-a6c7-0f742f23a257]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98fbf3a-4316-443e-a50a-979913069da1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:47:01 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:47:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dbe9a2-8485-4f2b-a4db-a989b7d082a5]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG os_brick.utils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:01 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating existing volume attachment record: a166d320-067b-4667-a899-2b9fa608de50 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:47:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance spawned successfully.
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-c82966de-2257-40a3-ad5b-1ebe5bed5e0d req-1c3a6b1c-3b9e-4386-b1bb-66313d5fc044 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c82966de-2257-40a3-ad5b-1ebe5bed5e0d req-1c3a6b1c-3b9e-4386-b1bb-66313d5fc044 service nova] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c82966de-2257-40a3-ad5b-1ebe5bed5e0d req-1c3a6b1c-3b9e-4386-b1bb-66313d5fc044 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c82966de-2257-40a3-ad5b-1ebe5bed5e0d req-1c3a6b1c-3b9e-4386-b1bb-66313d5fc044 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-c82966de-2257-40a3-ad5b-1ebe5bed5e0d req-1c3a6b1c-3b9e-4386-b1bb-66313d5fc044 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] No waiting events found dispatching network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:03 user nova-compute[75288]: WARNING nova.compute.manager [req-c82966de-2257-40a3-ad5b-1ebe5bed5e0d req-1c3a6b1c-3b9e-4386-b1bb-66313d5fc044 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received unexpected event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 for instance with vm_state building and task_state spawning.
Dec 01 13:47:03 user nova-compute[75288]: INFO nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Took 5.86 seconds to spawn the instance on the hypervisor.
Dec 01 13:47:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:47:03 user nova-compute[75288]: INFO nova.compute.manager [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Took 6.87 seconds to build instance.
Dec 01 13:47:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e53b56d5-692d-4d7a-8001-c21f7ee39773 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.980s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lazy-loading 'flavor' on Instance uuid 2c66ff7f-d0d9-43ff-98a4-bb702780e080 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:04 user nova-compute[75288]: INFO nova.compute.manager [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Attaching volume ad18d79c-5a70-415f-bb5b-740194fc3838 to /dev/vdb
Dec 01 13:47:04 user nova-compute[75288]: DEBUG os_brick.utils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f03cca4-3b8f-4b0e-9ed5-2725e2da9226]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dc02b3-0687-4d49-a9f7-27914699d0e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b885e04-e7a2-4882-a4d7-58e19f46eaca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccd2343-d13e-440a-91f1-44ef9e1fb24d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:47:04 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:47:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34e6c67-7f9b-4ff2-b4e1-4385fe241a4f]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG os_brick.utils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:04 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating existing volume attachment record: c3e4eb03-e390-4f0e-b588-ed82c8fce623 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:47:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtoIhrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:12 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:12 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:12 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5549fb8-733d-42dd-a153-af383eeca441]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:47:12 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f050bb93-06db-4358-8846-83bfb53b1d8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175] added
Dec 01 13:47:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.059s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5683ddc-4fcf-4518-ad25-92b5952fbdec]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[06655f0b-8ff3-4ade-b3ca-4657d6988cf4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYtoIhrP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYtoIhrP" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb602e01-0f16-453e-8faf-adafac750c52]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pYtoIhrP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df405a-0d54-4b29-a856-97952879c5fc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd01270-66eb-404f-9d02-dfc9039393be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66aa68b-12df-40af-9004-bd11a396bf4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175, portal: 172.16.0.220,3260]
Dec 01 13:47:12 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[008c31de-22e0-4288-85b4-dd40d20e4c3a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3af978-14c3-4c76-b857-8642b9002895]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce46906e-6443-4733-9261-a622b2462d6f]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:47:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtoIhrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:47:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26230306565396332', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230306565396332', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:47:13 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'flavor' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:47:13 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:47:13 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:47:13 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:47:13 user nova-compute[75288]:   <serial>8b89ddf0-7d91-4798-a7a7-b8bae33bf175</serial>
Dec 01 13:47:13 user nova-compute[75288]: </disk>
Dec 01 13:47:13 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:47:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No VIF found with MAC fa:16:3e:eb:4d:a9, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b5fa870a-4201-4156-a01f-cdf016a0211f tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.552s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:14 user nova-compute[75288]: INFO nova.compute.manager [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Rescuing
Dec 01 13:47:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquired lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:47:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Releasing lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTOxSFkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:15 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf8d9d6-aa16-42d8-9841-de770bf3fecc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:47:15 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c381a67-2bf2-414c-9ff1-7a2e80b457ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838] added
Dec 01 13:47:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-acc15db9-750d-4121-bbcb-5250054a5990 req-84e4ff23-2023-4e02-bc43-09abee1d6b1d service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acc15db9-750d-4121-bbcb-5250054a5990 req-84e4ff23-2023-4e02-bc43-09abee1d6b1d service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acc15db9-750d-4121-bbcb-5250054a5990 req-84e4ff23-2023-4e02-bc43-09abee1d6b1d service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acc15db9-750d-4121-bbcb-5250054a5990 req-84e4ff23-2023-4e02-bc43-09abee1d6b1d service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-acc15db9-750d-4121-bbcb-5250054a5990 req-84e4ff23-2023-4e02-bc43-09abee1d6b1d service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:15 user nova-compute[75288]: WARNING nova.compute.manager [req-acc15db9-750d-4121-bbcb-5250054a5990 req-84e4ff23-2023-4e02-bc43-09abee1d6b1d service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state active and task_state rescuing.
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc65fe83-ff96-43d0-b295-f47098313086]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee11360-831c-4c70-8cd8-8aa20070f70c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTOxSFkl {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTOxSFkl" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b17e9bc-26b9-4227-9ee3-567da84e95d8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dTOxSFkl'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1961f1-8a70-4389-8612-ed7fdd9ae6c7]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39af6e3-ea06-44f4-b214-ccf6711ddab8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d2aa4-e1e9-4511-8aef-5202252a1cdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838, portal: 172.16.0.220,3260]
Dec 01 13:47:16 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5280ca-009d-4c73-9543-d80a27e2450f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7cda32-7242-4be0-8884-b3b684ff0d3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98259ef-6265-4729-be6d-a577292dc79c]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTOxSFkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:47:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance destroyed successfully.
Dec 01 13:47:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Attempting a stable device rescue
Dec 01 13:47:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 13:47:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Creating image(s)
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "344bd39bb8bb9ef94493e15fa66b20a4f721768f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "344bd39bb8bb9ef94493e15fa66b20a4f721768f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.668s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] <== connect_volume: return (1671ms) {'type': 'block', 'scsi_wwn': '23864643236353339', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864643236353339', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lazy-loading 'flavor' on Instance uuid 2c66ff7f-d0d9-43ff-98a4-bb702780e080 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:17 user nova-compute[75288]: INFO nova.compute.manager [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Terminating instance
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:47:17 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:47:17 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:47:17 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:47:17 user nova-compute[75288]:   <serial>ad18d79c-5a70-415f-bb5b-740194fc3838</serial>
Dec 01 13:47:17 user nova-compute[75288]: </disk>
Dec 01 13:47:17 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.virt.images [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] d58ca753-300b-4ea0-8e7b-9095c1e9cec6 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f.part /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-8f57a1d3-e8e0-4344-995f-f781f8cfba06 req-c5d69ba9-ec07-4228-bb3d-b17ecb966d97 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received event network-vif-unplugged-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f57a1d3-e8e0-4344-995f-f781f8cfba06 req-c5d69ba9-ec07-4228-bb3d-b17ecb966d97 service nova] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f57a1d3-e8e0-4344-995f-f781f8cfba06 req-c5d69ba9-ec07-4228-bb3d-b17ecb966d97 service nova] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8f57a1d3-e8e0-4344-995f-f781f8cfba06 req-c5d69ba9-ec07-4228-bb3d-b17ecb966d97 service nova] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-8f57a1d3-e8e0-4344-995f-f781f8cfba06 req-c5d69ba9-ec07-4228-bb3d-b17ecb966d97 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] No waiting events found dispatching network-vif-unplugged-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-8f57a1d3-e8e0-4344-995f-f781f8cfba06 req-c5d69ba9-ec07-4228-bb3d-b17ecb966d97 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received event network-vif-unplugged-92d8f57c-0605-4509-abe5-e66257f43917 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f.part /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f.converted" returned: 0 in 0.316s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-6c47f811-409e-4786-8860-375513677737 req-f9b10169-391a-49a4-b942-92a8f6f09b2b service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6c47f811-409e-4786-8860-375513677737 req-f9b10169-391a-49a4-b942-92a8f6f09b2b service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6c47f811-409e-4786-8860-375513677737 req-f9b10169-391a-49a4-b942-92a8f6f09b2b service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6c47f811-409e-4786-8860-375513677737 req-f9b10169-391a-49a4-b942-92a8f6f09b2b service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-6c47f811-409e-4786-8860-375513677737 req-f9b10169-391a-49a4-b942-92a8f6f09b2b service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:18 user nova-compute[75288]: WARNING nova.compute.manager [req-6c47f811-409e-4786-8860-375513677737 req-f9b10169-391a-49a4-b942-92a8f6f09b2b service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state active and task_state rescuing.
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "344bd39bb8bb9ef94493e15fa66b20a4f721768f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.691s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "344bd39bb8bb9ef94493e15fa66b20a4f721768f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "344bd39bb8bb9ef94493e15fa66b20a4f721768f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] No VIF found with MAC fa:16:3e:1f:93:0b, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:47:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Instance destroyed successfully.
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lazy-loading 'resources' on Instance uuid d6528740-f062-4dd6-9b99-d41042e2abe4 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1822688833',display_name='tempest-TestVolumeSwap-server-1822688833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1822688833',id=6,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGbsDQvKG9hSVFFvi+4weDaFn+XTlHkOV5fZr1dxhPdm6EJ9A64G568xVIleS8NxvCAmFg/YuB4lVxXS+wUN37RfAWZoAGrUx9CVqwulWiFt9w/CvWn1fRaor/1IT5VaQ==',key_name='tempest-keypair-1889675105',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36d84360718549bba2baea876c19a537',ramdisk_id='',reservation_id='r-8zffgp78',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-463243492',owner_user_name='tempest-TestVolumeSwap-463243492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:43:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2de2c848885545cab7ce9c7f0ee7f948',uuid=d6528740-f062-4dd6-9b99-d41042e2abe4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Converting VIF {"id": "92d8f57c-0605-4509-abe5-e66257f43917", "address": "fa:16:3e:b3:8e:fc", "network": {"id": "582e865e-37c8-4bdb-baa9-d9878eff0c3d", "bridge": "br-int", "label": "tempest-TestVolumeSwap-165114337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36d84360718549bba2baea876c19a537", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92d8f57c-06", "ovs_interfaceid": "92d8f57c-0605-4509-abe5-e66257f43917", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=92d8f57c-0605-4509-abe5-e66257f43917,network=Network(582e865e-37c8-4bdb-baa9-d9878eff0c3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d8f57c-06') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_vif [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=92d8f57c-0605-4509-abe5-e66257f43917,network=Network(582e865e-37c8-4bdb-baa9-d9878eff0c3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d8f57c-06') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92d8f57c-06, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f,backing_fmt=raw /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4109a61-3ae7-418b-81b7-5f9fbaf63a25) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f,backing_fmt=raw /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue" returned: 0 in 0.065s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "344bd39bb8bb9ef94493e15fa66b20a4f721768f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'migration_context' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:18 user nova-compute[75288]: INFO os_vif [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:8e:fc,bridge_name='br-int',has_traffic_filtering=True,id=92d8f57c-0605-4509-abe5-e66257f43917,network=Network(582e865e-37c8-4bdb-baa9-d9878eff0c3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92d8f57c-06')
Dec 01 13:47:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Deleting instance files /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4_del
Dec 01 13:47:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Deletion of /opt/stack/data/nova/instances/d6528740-f062-4dd6-9b99-d41042e2abe4_del complete
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d3c963e6-4d63-4437-9cbb-a39c8f066ab7 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.720s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Object Instance<f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Start _get_guest_xml network_info=[{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "vif_mac": "fa:16:3e:eb:4d:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd58ca753-300b-4ea0-8e7b-9095c1e9cec6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a166d320-067b-4667-a899-2b9fa608de50', 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtoIhrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af', 'attached_at': '', 'detached_at': '', 'volume_id': '8b89ddf0-7d91-4798-a7a7-b8bae33bf175', 'serial': '8b89ddf0-7d91-4798-a7a7-b8bae33bf175'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'resources' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Object Instance<f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'numa_topology' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Object Instance<f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:47:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:47:18 user nova-compute[75288]: INFO nova.compute.manager [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Took 1.00 seconds to destroy the instance on the hypervisor.
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Object Instance<f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtoIhrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:18 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:18 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:18 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d2b807-0e95-4c94-bf3f-9bcfb8e8139a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pYtoIhrP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 13:47:18 user nova-compute[75288]: node.name = iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:47:18 user nova-compute[75288]: node.tpgt = -1
Dec 01 13:47:18 user nova-compute[75288]: node.startup = automatic
Dec 01 13:47:18 user nova-compute[75288]: node.leading_login = No
Dec 01 13:47:18 user nova-compute[75288]: iface.iscsi_ifacename = default
Dec 01 13:47:18 user nova-compute[75288]: iface.net_ifacename = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.ipaddress = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.prefix_len = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.hwaddress = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.transport_name = tcp
Dec 01 13:47:18 user nova-compute[75288]: iface.initiatorname = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.state = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.vlan_id = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.vlan_priority = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.vlan_state = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.iface_num = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.mtu = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.port = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.bootproto = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.subnet_mask = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.gateway = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.dhcp_alt_client_id = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.dhcp_dns = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.dhcp_learn_iqn = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.dhcp_vendor_id_state = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.dhcp_vendor_id = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.dhcp_slp_da = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.fragmentation = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.gratuitous_arp = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.incoming_forwarding = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.tos_state = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.tos = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.ttl = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.delayed_ack = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.tcp_nagle = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.tcp_wsf_state = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.tcp_wsf = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.tcp_timer_scale = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.tcp_timestamp = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.redirect = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.def_task_mgmt_timeout = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.header_digest = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.data_digest = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.immediate_data = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.initial_r2t = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.data_seq_inorder = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.data_pdu_inorder = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.erl = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.max_receive_data_len = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.first_burst_len = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.max_outstanding_r2t = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.max_burst_len = 0
Dec 01 13:47:18 user nova-compute[75288]: iface.chap_auth = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.bidi_chap = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.strict_login_compliance = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.discovery_auth = <empty>
Dec 01 13:47:18 user nova-compute[75288]: iface.discovery_logout = <empty>
Dec 01 13:47:18 user nova-compute[75288]: node.discovery_address = <empty>
Dec 01 13:47:18 user nova-compute[75288]: node.discovery_port = 0
Dec 01 13:47:18 user nova-compute[75288]: node.discovery_type = static
Dec 01 13:47:18 user nova-compute[75288]: node.session.initial_cmdsn = 0
Dec 01 13:47:18 user nova-compute[75288]: node.session.initial_login_retry_max = 8
Dec 01 13:47:18 user nova-compute[75288]: node.session.xmit_thread_priority = -20
Dec 01 13:47:18 user nova-compute[75288]: node.session.cmds_max = 128
Dec 01 13:47:18 user nova-compute[75288]: node.session.queue_depth = 32
Dec 01 13:47:18 user nova-compute[75288]: node.session.nr_sessions = 1
Dec 01 13:47:18 user nova-compute[75288]: node.session.auth.authmethod = CHAP
Dec 01 13:47:18 user nova-compute[75288]: node.session.auth.username = pYtoIhrP
Dec 01 13:47:18 user nova-compute[75288]: node.session.auth.password = ***
Dec 01 13:47:18 user nova-compute[75288]: node.session.auth.username_in = <empty>
Dec 01 13:47:18 user nova-compute[75288]: node.session.auth.password_in = <empty>
Dec 01 13:47:18 user nova-compute[75288]: node.session.auth.chap_algs = MD5
Dec 01 13:47:18 user nova-compute[75288]: node.session.timeo.replacement_timeout = 120
Dec 01 13:47:18 user nova-compute[75288]: node.session.err_timeo.abort_timeout = 15
Dec 01 13:47:18 user nova-compute[75288]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 13:47:18 user nova-compute[75288]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 13:47:18 user nova-compute[75288]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.FastAbort = Yes
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.InitialR2T = No
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.ImmediateData = Yes
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.MaxConnections = 1
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 13:47:18 user nova-compute[75288]: node.session.iscsi.ERL = 0
Dec 01 13:47:18 user nova-compute[75288]: node.session.scan = manual
Dec 01 13:47:18 user nova-compute[75288]: node.session.reopen_max = 0
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].address = 172.16.0.220
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].port = 3260
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].startup = manual
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].tcp.window_size = 524288
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].tcp.type_of_service = 0
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].timeo.logout_timeout = 15
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].timeo.login_timeout = 15
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].timeo.auth_timeout = 45
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].iscsi.DataDigest = None
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].iscsi.IFMarker = No
Dec 01 13:47:18 user nova-compute[75288]: node.conn[0].iscsi.OFMarker = No
Dec 01 13:47:18 user nova-compute[75288]: # END RECORD
Dec 01 13:47:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcbdd6f-8dad-4ce6-bf8c-ee665df8fccf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69bcf85-2ec8-4d7b-b403-cc0c65772e8f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYtoIhrP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYtoIhrP" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d49dd43-3d25-4626-8be4-4e38a4f0a2ae]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pYtoIhrP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b1409e-2476-4c39-8387-600df42ebba4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d061b7e-2cce-4dc8-b72e-d9d6ec7dd284]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be743ec-775f-4b47-af25-a51e3d920962]: (4, ('0 0 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtoIhrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '26230306565396332', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230306565396332', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1274625653',display_name='tempest-ServerStableDeviceRescueTest-server-1274625653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1274625653',id=4,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfA+ZDO7xALSyEhCRvYLfQ+xYp3su3wJdrLeQt71rSzduiAJ0Kj9QHOIOMdGWpjCmn0eSrw/Ozpvfaqj/WbpdwfUSNZlYZrAJSO6YTtD/s2q0XiPWvAb1X5yuNUVqfqiQ==',key_name='tempest-keypair-1837351537',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8816f73a6346a9a973142c4af6d381',ramdisk_id='',reservation_id='r-zsc9kejp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-918439040',owner_user_name='tempest-ServerStableDeviceRescueTest-918439040-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f0219ef4ab742cdb27296abc211a120',uuid=f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "vif_mac": "fa:16:3e:eb:4d:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Converting VIF {"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "vif_mac": "fa:16:3e:eb:4d:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:4d:a9,bridge_name='br-int',has_traffic_filtering=True,id=e41a567f-0fb6-4089-b693-d8d527576a17,network=Network(98055b13-feb2-4087-a8ea-124ab71ba571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41a567f-0f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'pci_devices' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.objects.base [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Object Instance<f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:47:18 user nova-compute[75288]:   <uuid>f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af</uuid>
Dec 01 13:47:18 user nova-compute[75288]:   <name>instance-00000004</name>
Dec 01 13:47:18 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:47:18 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:47:18 user nova-compute[75288]:   <metadata>
Dec 01 13:47:18 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:47:18 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:47:18 user nova-compute[75288]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1274625653</nova:name>
Dec 01 13:47:18 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:47:18</nova:creationTime>
Dec 01 13:47:18 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:47:18 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:47:18 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:47:18 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:47:18 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:47:18 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:47:18 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:47:18 user nova-compute[75288]:       <nova:owner>
Dec 01 13:47:18 user nova-compute[75288]:         <nova:user uuid="1f0219ef4ab742cdb27296abc211a120">tempest-ServerStableDeviceRescueTest-918439040-project-member</nova:user>
Dec 01 13:47:18 user nova-compute[75288]:         <nova:project uuid="bf8816f73a6346a9a973142c4af6d381">tempest-ServerStableDeviceRescueTest-918439040</nova:project>
Dec 01 13:47:18 user nova-compute[75288]:       </nova:owner>
Dec 01 13:47:18 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:47:18 user nova-compute[75288]:       <nova:ports>
Dec 01 13:47:18 user nova-compute[75288]:         <nova:port uuid="e41a567f-0fb6-4089-b693-d8d527576a17">
Dec 01 13:47:18 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:47:18 user nova-compute[75288]:         </nova:port>
Dec 01 13:47:18 user nova-compute[75288]:       </nova:ports>
Dec 01 13:47:18 user nova-compute[75288]:     </nova:instance>
Dec 01 13:47:18 user nova-compute[75288]:   </metadata>
Dec 01 13:47:18 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:47:18 user nova-compute[75288]:     <system>
Dec 01 13:47:18 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:47:18 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:47:18 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:47:18 user nova-compute[75288]:       <entry name="serial">f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af</entry>
Dec 01 13:47:18 user nova-compute[75288]:       <entry name="uuid">f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af</entry>
Dec 01 13:47:18 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:47:18 user nova-compute[75288]:     </system>
Dec 01 13:47:18 user nova-compute[75288]:   </sysinfo>
Dec 01 13:47:18 user nova-compute[75288]:   <os>
Dec 01 13:47:18 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:47:18 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:47:18 user nova-compute[75288]:   </os>
Dec 01 13:47:18 user nova-compute[75288]:   <features>
Dec 01 13:47:18 user nova-compute[75288]:     <acpi/>
Dec 01 13:47:18 user nova-compute[75288]:     <apic/>
Dec 01 13:47:18 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:47:18 user nova-compute[75288]:   </features>
Dec 01 13:47:18 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:47:18 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:47:18 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:47:18 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:47:18 user nova-compute[75288]:   </clock>
Dec 01 13:47:18 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:47:18 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:47:18 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:47:18 user nova-compute[75288]:   </cpu>
Dec 01 13:47:18 user nova-compute[75288]:   <devices>
Dec 01 13:47:18 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:47:18 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:47:18 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk"/>
Dec 01 13:47:18 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:47:18 user nova-compute[75288]:     </disk>
Dec 01 13:47:18 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:47:18 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:47:18 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Dec 01 13:47:18 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 13:47:18 user nova-compute[75288]:       <serial>8b89ddf0-7d91-4798-a7a7-b8bae33bf175</serial>
Dec 01 13:47:18 user nova-compute[75288]:     </disk>
Dec 01 13:47:18 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:47:18 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:47:18 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue"/>
Dec 01 13:47:18 user nova-compute[75288]:       <target dev="vdc" bus="virtio"/>
Dec 01 13:47:18 user nova-compute[75288]:       <boot order="1"/>
Dec 01 13:47:18 user nova-compute[75288]:     </disk>
Dec 01 13:47:18 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:47:18 user nova-compute[75288]:       <mac address="fa:16:3e:eb:4d:a9"/>
Dec 01 13:47:18 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:47:18 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:47:18 user nova-compute[75288]:       <target dev="tape41a567f-0f"/>
Dec 01 13:47:18 user nova-compute[75288]:     </interface>
Dec 01 13:47:18 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:47:18 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/console.log" append="off"/>
Dec 01 13:47:18 user nova-compute[75288]:     </serial>
Dec 01 13:47:18 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:47:18 user nova-compute[75288]:     <video>
Dec 01 13:47:18 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:47:18 user nova-compute[75288]:     </video>
Dec 01 13:47:18 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:47:18 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:47:18 user nova-compute[75288]:     </rng>
Dec 01 13:47:18 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:47:18 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:47:18 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:47:18 user nova-compute[75288]:     </memballoon>
Dec 01 13:47:18 user nova-compute[75288]:   </devices>
Dec 01 13:47:18 user nova-compute[75288]: </domain>
Dec 01 13:47:18 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:47:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance destroyed successfully.
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] No VIF found with MAC fa:16:3e:eb:4d:a9, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:19 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Took 1.02 seconds to deallocate network for instance.
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f2949de-e932-4294-9f7f-a48289fac2b0 req-3bba0259-7908-471c-ac51-d62657864370 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received event network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f2949de-e932-4294-9f7f-a48289fac2b0 req-3bba0259-7908-471c-ac51-d62657864370 service nova] Acquiring lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f2949de-e932-4294-9f7f-a48289fac2b0 req-3bba0259-7908-471c-ac51-d62657864370 service nova] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f2949de-e932-4294-9f7f-a48289fac2b0 req-3bba0259-7908-471c-ac51-d62657864370 service nova] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f2949de-e932-4294-9f7f-a48289fac2b0 req-3bba0259-7908-471c-ac51-d62657864370 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] No waiting events found dispatching network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:19 user nova-compute[75288]: WARNING nova.compute.manager [req-7f2949de-e932-4294-9f7f-a48289fac2b0 req-3bba0259-7908-471c-ac51-d62657864370 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received unexpected event network-vif-plugged-92d8f57c-0605-4509-abe5-e66257f43917 for instance with vm_state deleted and task_state None.
Dec 01 13:47:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f2949de-e932-4294-9f7f-a48289fac2b0 req-3bba0259-7908-471c-ac51-d62657864370 service nova] [instance: d6528740-f062-4dd6-9b99-d41042e2abe4] Received event network-vif-deleted-92d8f57c-0605-4509-abe5-e66257f43917 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:20 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Deleted allocations for instance d6528740-f062-4dd6-9b99-d41042e2abe4
Dec 01 13:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36fda5a1-040b-44e7-99c3-c93d4eae884c tempest-TestVolumeSwap-463243492 tempest-TestVolumeSwap-463243492-project-member] Lock "d6528740-f062-4dd6-9b99-d41042e2abe4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.653s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Stashing vm_state: active {{(pid=75288) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:47:20 user nova-compute[75288]: INFO nova.compute.claims [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Claim successful on node user
Dec 01 13:47:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-51a3cc3e-c408-448c-aa0a-f699e3bf9d72 req-3c2b5109-b21c-4d5d-b5a7-3ee5626572ba service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-51a3cc3e-c408-448c-aa0a-f699e3bf9d72 req-3c2b5109-b21c-4d5d-b5a7-3ee5626572ba service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-51a3cc3e-c408-448c-aa0a-f699e3bf9d72 req-3c2b5109-b21c-4d5d-b5a7-3ee5626572ba service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-51a3cc3e-c408-448c-aa0a-f699e3bf9d72 req-3c2b5109-b21c-4d5d-b5a7-3ee5626572ba service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-51a3cc3e-c408-448c-aa0a-f699e3bf9d72 req-3c2b5109-b21c-4d5d-b5a7-3ee5626572ba service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:20 user nova-compute[75288]: WARNING nova.compute.manager [req-51a3cc3e-c408-448c-aa0a-f699e3bf9d72 req-3c2b5109-b21c-4d5d-b5a7-3ee5626572ba service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state active and task_state rescuing.
Dec 01 13:47:20 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating resource usage from migration 026c43db-a46f-495d-a500-7e7de874989c
Dec 01 13:47:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.578s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:21 user nova-compute[75288]: INFO nova.compute.manager [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Migrating
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:21 user nova-compute[75288]: INFO nova.compute.rpcapi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquired lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating instance_info_cache with network_info: [{"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Releasing lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Starting migrate_disk_and_power_off {{(pid=75288) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-930d795f-8e79-4ef3-b889-2390416a4a87 req-c706b7b2-4756-4383-b50f-9b93a16793a3 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received event network-vif-unplugged-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-930d795f-8e79-4ef3-b889-2390416a4a87 req-c706b7b2-4756-4383-b50f-9b93a16793a3 service nova] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-930d795f-8e79-4ef3-b889-2390416a4a87 req-c706b7b2-4756-4383-b50f-9b93a16793a3 service nova] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-930d795f-8e79-4ef3-b889-2390416a4a87 req-c706b7b2-4756-4383-b50f-9b93a16793a3 service nova] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-930d795f-8e79-4ef3-b889-2390416a4a87 req-c706b7b2-4756-4383-b50f-9b93a16793a3 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] No waiting events found dispatching network-vif-unplugged-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:22 user nova-compute[75288]: WARNING nova.compute.manager [req-930d795f-8e79-4ef3-b889-2390416a4a87 req-c706b7b2-4756-4383-b50f-9b93a16793a3 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received unexpected event network-vif-unplugged-94a9b395-6933-43ea-89a6-77157cac1f75 for instance with vm_state active and task_state resize_migrating.
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-1de02a99-a507-438c-bedf-30e1cc38b4bc req-98a4870c-b746-4934-a89e-2e8c0b5382fc service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1de02a99-a507-438c-bedf-30e1cc38b4bc req-98a4870c-b746-4934-a89e-2e8c0b5382fc service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1de02a99-a507-438c-bedf-30e1cc38b4bc req-98a4870c-b746-4934-a89e-2e8c0b5382fc service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1de02a99-a507-438c-bedf-30e1cc38b4bc req-98a4870c-b746-4934-a89e-2e8c0b5382fc service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-1de02a99-a507-438c-bedf-30e1cc38b4bc req-98a4870c-b746-4934-a89e-2e8c0b5382fc service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:22 user nova-compute[75288]: WARNING nova.compute.manager [req-1de02a99-a507-438c-bedf-30e1cc38b4bc req-98a4870c-b746-4934-a89e-2e8c0b5382fc service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state active and task_state rescuing.
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance destroyed successfully.
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-745559289',display_name='tempest-ServerActionsTestOtherB-server-745559289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-745559289',id=5,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzL1MpDodMkY+xvBqITOaLy5oBm4DD5VJVvVNoHnn6Mtxt7m0WXVws5RbvQGMPz+LPvt+IaVJRN4WJicpVCtlvPZ8kIrh2x/RVC8OCU5xD58QPVXNLfLtbDizY9sQOGnQ==',key_name='tempest-keypair-1567478084',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fd88f5d625df4e6dadf00024d504d6d1',ramdisk_id='',reservation_id='r-dxvhm1gl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-497654762',owner_user_name='tempest-ServerActionsTestOtherB-497654762-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b7739fa771e43c6b503e89ff7de7221',uuid=2c66ff7f-d0d9-43ff-98a4-bb702780e080,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57522546-network", "vif_mac": "fa:16:3e:1f:93:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Converting VIF {"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-57522546-network", "vif_mac": "fa:16:3e:1f:93:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_vif [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94a9b395-69, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=448198af-3a22-4470-a0db-21ebcc033d8c) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:22 user nova-compute[75288]: INFO os_vif [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69')
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTOxSFkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:22 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2d3835ad-f1d4-42d6-b03e-6bb949a7b602 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c744c7bb-57ac-4128-aae9-ed1aa92133a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:47:22 user nova-compute[75288]: No targets found.
Dec 01 13:47:22 user nova-compute[75288]: iSNS:
Dec 01 13:47:22 user nova-compute[75288]: No targets found.
Dec 01 13:47:22 user nova-compute[75288]: STATIC:
Dec 01 13:47:22 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:47:22 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:22 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:22 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:47:22 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:22 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:22 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:47:22 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:22 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:22 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838
Dec 01 13:47:22 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:22 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:22 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:47:22 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:22 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:22 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:47:22 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:22 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:22 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:47:22 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:22 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:22 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:47:22 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:22 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:22 user nova-compute[75288]: FIRMWARE:
Dec 01 13:47:22 user nova-compute[75288]: No targets found.
Dec 01 13:47:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:47:22 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:47:22 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daf374a-9f25-4596-a556-6cad0afcc256]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece7531e-afea-4b16-80d5-fa747be439ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:22 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e70160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:47:22 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5172285-d61f-4b21-a334-da1b349aafba]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0e63a2-669d-4c5e-af25-04031f471139]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[639a12cd-5d45-473e-a9c1-2eb81a1b6a73]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[265d4fa2-ffec-40a3-ba27-7176272293db]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9b0cee-7640-4182-8d00-e36135e98c7e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabf246d-98c3-4330-bb4e-53349bb34806]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838, portal: 172.16.0.220,3260]
Dec 01 13:47:23 user nova-compute[75288]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b12a4fc-5e04-4f40-ba7d-dbc5d98ccbbf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] <== disconnect_volume: return (455ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize/disk /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdk (vdc) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-4617a2ad-6f6e-488e-8b4e-295d785f26cf req-936e40c9-71f9-47de-8d9e-a84df274c004 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received event network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4617a2ad-6f6e-488e-8b4e-295d785f26cf req-936e40c9-71f9-47de-8d9e-a84df274c004 service nova] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4617a2ad-6f6e-488e-8b4e-295d785f26cf req-936e40c9-71f9-47de-8d9e-a84df274c004 service nova] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4617a2ad-6f6e-488e-8b4e-295d785f26cf req-936e40c9-71f9-47de-8d9e-a84df274c004 service nova] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-4617a2ad-6f6e-488e-8b4e-295d785f26cf req-936e40c9-71f9-47de-8d9e-a84df274c004 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] No waiting events found dispatching network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:24 user nova-compute[75288]: WARNING nova.compute.manager [req-4617a2ad-6f6e-488e-8b4e-295d785f26cf req-936e40c9-71f9-47de-8d9e-a84df274c004 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received unexpected event network-vif-plugged-94a9b395-6933-43ea-89a6-77157cac1f75 for instance with vm_state active and task_state resize_migrating.
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "cp -r /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize/disk /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk" returned: 0 in 0.964s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize/disk.info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk.info {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] CMD "cp -r /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize/disk.info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk.info" returned: 0 in 0.037s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-37bc50b4-d2de-449f-b981-9f20c42e9dc4 req-54465595-bf44-472c-9c20-af841161d7df service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-changed-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-37bc50b4-d2de-449f-b981-9f20c42e9dc4 req-54465595-bf44-472c-9c20-af841161d7df service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing instance network info cache due to event network-changed-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37bc50b4-d2de-449f-b981-9f20c42e9dc4 req-54465595-bf44-472c-9c20-af841161d7df service nova] Acquiring lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37bc50b4-d2de-449f-b981-9f20c42e9dc4 req-54465595-bf44-472c-9c20-af841161d7df service nova] Acquired lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-37bc50b4-d2de-449f-b981-9f20c42e9dc4 req-54465595-bf44-472c-9c20-af841161d7df service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Refreshing network info cache for port 4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:47:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:47:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7414MB free_disk=25.377368927001953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Applying migration context for instance 2c66ff7f-d0d9-43ff-98a4-bb702780e080 as it has an incoming, in-progress migration 026c43db-a46f-495d-a500-7e7de874989c. Migration status is migrating {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 13:47:25 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating resource usage from migration 026c43db-a46f-495d-a500-7e7de874989c
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0ab72540-6333-4a3b-bb5f-411e607bac1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 7834a8ee-1c0c-49e1-8b47-70ce3b64c702 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8541199a-393b-445d-8945-11fc3f9d0bd9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2aba04bd-402b-4a52-8394-3a59339a8f9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 64e25352-1ed2-4eda-a376-cb722f0b779f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Migration 026c43db-a46f-495d-a500-7e7de874989c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2c66ff7f-d0d9-43ff-98a4-bb702780e080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-37bc50b4-d2de-449f-b981-9f20c42e9dc4 req-54465595-bf44-472c-9c20-af841161d7df service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updated VIF entry in instance network info cache for port 4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-37bc50b4-d2de-449f-b981-9f20c42e9dc4 req-54465595-bf44-472c-9c20-af841161d7df service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [{"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Port 94a9b395-6933-43ea-89a6-77157cac1f75 binding to destination host user is already ACTIVE {{(pid=75288) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 01 13:47:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37bc50b4-d2de-449f-b981-9f20c42e9dc4 req-54465595-bf44-472c-9c20-af841161d7df service nova] Releasing lock "refresh_cache-7834a8ee-1c0c-49e1-8b47-70ce3b64c702" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquired lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating instance_info_cache with network_info: [{"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Releasing lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f03fa-dde8-42a8-8dab-744fd090466d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca74b8ed-bfea-426a-80c6-cb1df4bbaafa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a642c0-f3e0-43a4-a9cb-f8b0e4c8cf5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3168b915-8c5d-4708-8ea5-e18bc14f797c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:47:26 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:47:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf17b2-c54e-41e7-b037-616fe19e7a66]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:47:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:27 user nova-compute[75288]: INFO nova.compute.manager [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Terminating instance
Dec 01 13:47:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-5ab7dfe7-e741-4917-8722-8be8349dd2f9 req-fe5909e1-487b-4709-b63a-f197f1336ab1 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5ab7dfe7-e741-4917-8722-8be8349dd2f9 req-fe5909e1-487b-4709-b63a-f197f1336ab1 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5ab7dfe7-e741-4917-8722-8be8349dd2f9 req-fe5909e1-487b-4709-b63a-f197f1336ab1 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5ab7dfe7-e741-4917-8722-8be8349dd2f9 req-fe5909e1-487b-4709-b63a-f197f1336ab1 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-5ab7dfe7-e741-4917-8722-8be8349dd2f9 req-fe5909e1-487b-4709-b63a-f197f1336ab1 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-unplugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-5ab7dfe7-e741-4917-8722-8be8349dd2f9 req-fe5909e1-487b-4709-b63a-f197f1336ab1 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-0c3eac5b-5b92-4c1d-9128-575fd4279ffa req-7c21812f-868b-4c41-8a7b-fa1f66374ba2 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c3eac5b-5b92-4c1d-9128-575fd4279ffa req-7c21812f-868b-4c41-8a7b-fa1f66374ba2 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c3eac5b-5b92-4c1d-9128-575fd4279ffa req-7c21812f-868b-4c41-8a7b-fa1f66374ba2 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0c3eac5b-5b92-4c1d-9128-575fd4279ffa req-7c21812f-868b-4c41-8a7b-fa1f66374ba2 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-0c3eac5b-5b92-4c1d-9128-575fd4279ffa req-7c21812f-868b-4c41-8a7b-fa1f66374ba2 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-unplugged-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-0c3eac5b-5b92-4c1d-9128-575fd4279ffa req-7c21812f-868b-4c41-8a7b-fa1f66374ba2 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-63109067-3882-4582-85c2-b0e33c24ce6f for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8eb7ba0-7dc4-4642-b764-0f30ec7996de req-a43f2b84-c4b3-4d5c-b424-b415b4324f91 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8eb7ba0-7dc4-4642-b764-0f30ec7996de req-a43f2b84-c4b3-4d5c-b424-b415b4324f91 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8eb7ba0-7dc4-4642-b764-0f30ec7996de req-a43f2b84-c4b3-4d5c-b424-b415b4324f91 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8eb7ba0-7dc4-4642-b764-0f30ec7996de req-a43f2b84-c4b3-4d5c-b424-b415b4324f91 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8eb7ba0-7dc4-4642-b764-0f30ec7996de req-a43f2b84-c4b3-4d5c-b424-b415b4324f91 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-unplugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8eb7ba0-7dc4-4642-b764-0f30ec7996de req-a43f2b84-c4b3-4d5c-b424-b415b4324f91 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Instance destroyed successfully.
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lazy-loading 'resources' on Instance uuid 7834a8ee-1c0c-49e1-8b47-70ce3b64c702 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:03:c3,bridge_name='br-int',has_traffic_filtering=True,id=4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2,network=Network(71d8cac8-2f61-4212-bd51-88aed5c3b3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c862e27-9d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:03:c3,bridge_name='br-int',has_traffic_filtering=True,id=4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2,network=Network(71d8cac8-2f61-4212-bd51-88aed5c3b3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c862e27-9d') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c862e27-9d, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a638725b-6d55-48c2-b298-328b604ee09e) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: INFO os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:03:c3,bridge_name='br-int',has_traffic_filtering=True,id=4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2,network=Network(71d8cac8-2f61-4212-bd51-88aed5c3b3b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c862e27-9d')
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=c8144593-0826-4a56-bcb1-0eb7faa68f3a,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc8144593-08') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=c8144593-0826-4a56-bcb1-0eb7faa68f3a,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc8144593-08') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8144593-08, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ef5a86c-d538-43b6-8809-9825f72685b5) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: INFO os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:6c:93,bridge_name='br-int',has_traffic_filtering=True,id=c8144593-0826-4a56-bcb1-0eb7faa68f3a,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc8144593-08')
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=22ecad86-3a29-4f33-88d9-10a4b10569f5,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ecad86-3a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=22ecad86-3a29-4f33-88d9-10a4b10569f5,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ecad86-3a') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22ecad86-3a, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=569327be-8b80-47eb-967e-2d24e7ac62b4) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: INFO os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8b:b5,bridge_name='br-int',has_traffic_filtering=True,id=22ecad86-3a29-4f33-88d9-10a4b10569f5,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ecad86-3a')
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=689e9e88-11d4-4fdb-9762-ee44d52fe74d,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689e9e88-11') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=689e9e88-11d4-4fdb-9762-ee44d52fe74d,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689e9e88-11') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: WARNING nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 for instance with vm_state active and task_state deleting.
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-unplugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: WARNING nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-c8144593-0826-4a56-bcb1-0eb7faa68f3a for instance with vm_state active and task_state deleting.
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-unplugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: WARNING nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-22ecad86-3a29-4f33-88d9-10a4b10569f5 for instance with vm_state active and task_state deleting.
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-unplugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: WARNING nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-689e9e88-11d4-4fdb-9762-ee44d52fe74d for instance with vm_state active and task_state deleting.
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-unplugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-unplugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:29 user nova-compute[75288]: WARNING nova.compute.manager [req-3a0c0457-b8d7-4034-9864-e12ba18081b1 req-4b72554f-d008-40ca-a9e0-4486c6939995 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-5c91590c-ef72-4c8e-8b32-405d39bbed6f for instance with vm_state active and task_state deleting.
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap689e9e88-11, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac396072-1d92-4276-8341-48b8de06e14e) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: INFO os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:2b:d3,bridge_name='br-int',has_traffic_filtering=True,id=689e9e88-11d4-4fdb-9762-ee44d52fe74d,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap689e9e88-11')
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:d3:c4,bridge_name='br-int',has_traffic_filtering=True,id=5c91590c-ef72-4c8e-8b32-405d39bbed6f,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c91590c-ef') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:d3:c4,bridge_name='br-int',has_traffic_filtering=True,id=5c91590c-ef72-4c8e-8b32-405d39bbed6f,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c91590c-ef') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c91590c-ef, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=781538da-abec-4ea3-b5b1-7093d55f3bb7) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: INFO os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:d3:c4,bridge_name='br-int',has_traffic_filtering=True,id=5c91590c-ef72-4c8e-8b32-405d39bbed6f,network=Network(6784c2d5-1f01-4ee4-bc6f-991bddc76c91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c91590c-ef')
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "63109067-3882-4582-85c2-b0e33c24ce6f", "address": "fa:16:3e:6d:ca:49", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63109067-38", "ovs_interfaceid": "63109067-3882-4582-85c2-b0e33c24ce6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ca:49,bridge_name='br-int',has_traffic_filtering=True,id=63109067-3882-4582-85c2-b0e33c24ce6f,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63109067-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ca:49,bridge_name='br-int',has_traffic_filtering=True,id=63109067-3882-4582-85c2-b0e33c24ce6f,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63109067-38') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63109067-38, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fedb59b9-fa7e-4a45-a2d5-68ea44b62cf1) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: INFO os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:ca:49,bridge_name='br-int',has_traffic_filtering=True,id=63109067-3882-4582-85c2-b0e33c24ce6f,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63109067-38')
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1185027924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1185027924',id=11,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2v6pDf47Cq4YUcEdv77S9QmQLxGkXWRFtCPTb+ME8qBCrIJPG5xCnCvwvhWwKIXO4JCwfr9Py6KszV5SQ8WcLBhYtoSPxrSbG5y1yyoxJNbRScO7pweroLVJLvZnQUmQ==',key_name='tempest-keypair-1416130627',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bc0d4c7e27d4241be2c3ea05267de7a',ramdisk_id='',reservation_id='r-5g1co8n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1913742395',owner_user_name='tempest-TaggedBootDevicesTest_v242-1913742395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18550a125f0a418c9d9c4565e26f5358',uuid=7834a8ee-1c0c-49e1-8b47-70ce3b64c702,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converting VIF {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:f7,bridge_name='br-int',has_traffic_filtering=True,id=eea6e247-33fe-41c7-82d5-58ffbf9187fc,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea6e247-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:f7,bridge_name='br-int',has_traffic_filtering=True,id=eea6e247-33fe-41c7-82d5-58ffbf9187fc,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea6e247-33') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeea6e247-33, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20fd97eb-24c0-40a3-93b7-c7d45b8b1275) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:29 user nova-compute[75288]: INFO os_vif [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c9:f7,bridge_name='br-int',has_traffic_filtering=True,id=eea6e247-33fe-41c7-82d5-58ffbf9187fc,network=Network(9154c7b6-bc54-4206-a66a-308cc60a9ca5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea6e247-33')
Dec 01 13:47:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzOQjsbk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:29 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11cf9b9-b1f2-4921-b20c-ce87899df3c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:47:29 user nova-compute[75288]: No targets found.
Dec 01 13:47:29 user nova-compute[75288]: iSNS:
Dec 01 13:47:29 user nova-compute[75288]: No targets found.
Dec 01 13:47:29 user nova-compute[75288]: STATIC:
Dec 01 13:47:29 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:47:29 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:29 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:29 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:47:29 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:29 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:29 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1
Dec 01 13:47:29 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:29 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:29 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:47:29 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:29 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:29 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:47:29 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:29 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:29 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:47:29 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:29 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:29 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:47:29 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:29 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:29 user nova-compute[75288]: FIRMWARE:
Dec 01 13:47:29 user nova-compute[75288]: No targets found.
Dec 01 13:47:29 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:47:29 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:47:29 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4bd101-e513-4f35-90e4-fdbbe1c168c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7dc40d-6752-4cda-9f00-172a0285db82]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 (non-flash)
Dec 01 13:47:29 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e71cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1'): ({'sdi'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:47:29 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Removing single pathed devices sdi {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4645819e-58d3-49f1-a845-d29ace1539f1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc65c9-1030-48c3-9502-20c5a2fecede]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Flushing IO for device /dev/sdi {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bcaedc-ddb7-45f3-ac3f-ee24f1a1ab6b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0a706c-b038-46cc-af86-7a05139d402f]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] SCSI volumes sdi have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97911d69-15af-41a5-b8e4-3f4c53658ac4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-e146a75a-6594-40db-bac5-97d7dd44bd85 req-8e2aa8b5-c8f5-4584-8425-09fc40a326b1 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e146a75a-6594-40db-bac5-97d7dd44bd85 req-8e2aa8b5-c8f5-4584-8425-09fc40a326b1 service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e146a75a-6594-40db-bac5-97d7dd44bd85 req-8e2aa8b5-c8f5-4584-8425-09fc40a326b1 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e146a75a-6594-40db-bac5-97d7dd44bd85 req-8e2aa8b5-c8f5-4584-8425-09fc40a326b1 service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-e146a75a-6594-40db-bac5-97d7dd44bd85 req-8e2aa8b5-c8f5-4584-8425-09fc40a326b1 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:30 user nova-compute[75288]: WARNING nova.compute.manager [req-e146a75a-6594-40db-bac5-97d7dd44bd85 req-8e2aa8b5-c8f5-4584-8425-09fc40a326b1 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-63109067-3882-4582-85c2-b0e33c24ce6f for instance with vm_state active and task_state deleting.
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6001fdfd-610c-4a70-904c-f463741a8198]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1, portal: 172.16.0.220,3260]
Dec 01 13:47:30 user nova-compute[75288]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:401625e6-8a94-47a2-bd63-271b7866c5b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f720c5-eda7-42c9-a228-7df0b06ae720]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== disconnect_volume: return (397ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPXbhCos', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:30 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3172f3-437d-4c5d-a296-0b725e207a95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:47:30 user nova-compute[75288]: No targets found.
Dec 01 13:47:30 user nova-compute[75288]: iSNS:
Dec 01 13:47:30 user nova-compute[75288]: No targets found.
Dec 01 13:47:30 user nova-compute[75288]: STATIC:
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: FIRMWARE:
Dec 01 13:47:30 user nova-compute[75288]: No targets found.
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:47:30 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:47:30 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c974d64a-3183-4464-9ddc-92e62d44e2e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc917417-31d6-4c46-91bb-bc189e011224]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98f16440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87'): ({'sdh'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Removing single pathed devices sdh {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f32fcd-7f48-41d7-835c-169f6d9aa6c8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-001ccd68-ae8a-46fc-91ce-07a1a6a58b28 req-5319324f-d4fa-412d-b2c0-783c6e080cfb service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-001ccd68-ae8a-46fc-91ce-07a1a6a58b28 req-5319324f-d4fa-412d-b2c0-783c6e080cfb service nova] Acquiring lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-001ccd68-ae8a-46fc-91ce-07a1a6a58b28 req-5319324f-d4fa-412d-b2c0-783c6e080cfb service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-001ccd68-ae8a-46fc-91ce-07a1a6a58b28 req-5319324f-d4fa-412d-b2c0-783c6e080cfb service nova] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-001ccd68-ae8a-46fc-91ce-07a1a6a58b28 req-5319324f-d4fa-412d-b2c0-783c6e080cfb service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] No waiting events found dispatching network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:30 user nova-compute[75288]: WARNING nova.compute.manager [req-001ccd68-ae8a-46fc-91ce-07a1a6a58b28 req-5319324f-d4fa-412d-b2c0-783c6e080cfb service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received unexpected event network-vif-plugged-eea6e247-33fe-41c7-82d5-58ffbf9187fc for instance with vm_state active and task_state deleting.
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f432f6d-0436-4f70-91a0-4b3939b104af]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Flushing IO for device /dev/sdh {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b7735d-a9c6-4a03-82f0-2b89152e5d63]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4406d4bf-081a-4623-b63b-452ce8d80589]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] SCSI volumes sdh have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a280eb-455c-4856-9a51-17963cdf1d81]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd7668-8108-4001-9fd5-59582fa0bbf6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87, portal: 172.16.0.220,3260]
Dec 01 13:47:30 user nova-compute[75288]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:649ecbff-97a1-4432-ae18-3e15b9c0dc87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518c7a4-9dd0-40f1-be1a-bb05e95ec422]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== disconnect_volume: return (340ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxbnqURQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:30 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[170257cf-d987-4102-bf5b-cbc95f9600ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:47:30 user nova-compute[75288]: No targets found.
Dec 01 13:47:30 user nova-compute[75288]: iSNS:
Dec 01 13:47:30 user nova-compute[75288]: No targets found.
Dec 01 13:47:30 user nova-compute[75288]: STATIC:
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:47:30 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:30 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:30 user nova-compute[75288]: FIRMWARE:
Dec 01 13:47:30 user nova-compute[75288]: No targets found.
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:47:30 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:47:30 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79aa4ff-44a4-4582-9d9b-28a59fecf8e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e24caf-2197-4310-9960-0b6c9a055930]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 (non-flash)
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e3ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53'): ({'sdg'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Removing single pathed devices sdg {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[886ac938-922e-4ced-bb9a-5205da9ff453]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e689710-05cb-4b61-9730-2e46ed2fc44b]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Flushing IO for device /dev/sdg {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cb3f2b-a1f3-4fe9-b9b6-b7b7df659e39]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[503f1574-77f3-4526-86c4-df0ea0a01ae7]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] SCSI volumes sdg have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f960cf-9fba-48c3-bbc7-5a73806eeee8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f29ed2a-6f8b-4b05-aaa0-c8ac0fff9933]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53, portal: 172.16.0.220,3260]
Dec 01 13:47:30 user nova-compute[75288]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:30 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f962286e-7129-4755-9a1d-4c9c67bd3f53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0394ee-6d67-4656-ac19-62b04d8ea51f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] <== disconnect_volume: return (332ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:47:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Deleting instance files /opt/stack/data/nova/instances/7834a8ee-1c0c-49e1-8b47-70ce3b64c702_del
Dec 01 13:47:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Deletion of /opt/stack/data/nova/instances/7834a8ee-1c0c-49e1-8b47-70ce3b64c702_del complete
Dec 01 13:47:31 user nova-compute[75288]: INFO nova.compute.manager [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Took 3.84 seconds to destroy the instance on the hypervisor.
Dec 01 13:47:31 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:47:31 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:47:31 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:47:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-afd4c030-3e93-470e-92d3-d19fba29254a req-7972f3a7-d55d-4543-9f4b-1d61cb61db6b service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-deleted-63109067-3882-4582-85c2-b0e33c24ce6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:32 user nova-compute[75288]: INFO nova.compute.manager [req-afd4c030-3e93-470e-92d3-d19fba29254a req-7972f3a7-d55d-4543-9f4b-1d61cb61db6b service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Neutron deleted interface 63109067-3882-4582-85c2-b0e33c24ce6f; detaching it from the instance and deleting it from the info cache
Dec 01 13:47:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-afd4c030-3e93-470e-92d3-d19fba29254a req-7972f3a7-d55d-4543-9f4b-1d61cb61db6b service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [{"id": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "address": "fa:16:3e:f0:03:c3", "network": {"id": "71d8cac8-2f61-4212-bd51-88aed5c3b3b4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-920287739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c862e27-9d", "ovs_interfaceid": "4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "address": "fa:16:3e:da:6c:93", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8144593-08", "ovs_interfaceid": "c8144593-0826-4a56-bcb1-0eb7faa68f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "address": "fa:16:3e:f2:8b:b5", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ecad86-3a", "ovs_interfaceid": "22ecad86-3a29-4f33-88d9-10a4b10569f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "address": "fa:16:3e:61:2b:d3", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.133", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap689e9e88-11", "ovs_interfaceid": "689e9e88-11d4-4fdb-9762-ee44d52fe74d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "address": "fa:16:3e:84:d3:c4", "network": {"id": "6784c2d5-1f01-4ee4-bc6f-991bddc76c91", "bridge": "br-int", "label": "tempest-device-tagging-net1-688813652", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.252", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c91590c-ef", "ovs_interfaceid": "5c91590c-ef72-4c8e-8b32-405d39bbed6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "address": "fa:16:3e:f7:c9:f7", "network": {"id": "9154c7b6-bc54-4206-a66a-308cc60a9ca5", "bridge": "br-int", "label": "tempest-device-tagging-net2-649589127", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6bc0d4c7e27d4241be2c3ea05267de7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea6e247-33", "ovs_interfaceid": "eea6e247-33fe-41c7-82d5-58ffbf9187fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-afd4c030-3e93-470e-92d3-d19fba29254a req-7972f3a7-d55d-4543-9f4b-1d61cb61db6b service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Detach interface failed, port_id=63109067-3882-4582-85c2-b0e33c24ce6f, reason: Instance 7834a8ee-1c0c-49e1-8b47-70ce3b64c702 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:47:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:34 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:34 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Took 3.93 seconds to deallocate network for instance.
Dec 01 13:47:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-83d77c4c-0b9d-4371-ad2a-ac5f9ac9c161 req-9c49357a-9aef-4e83-be57-b9877bff1c28 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-deleted-689e9e88-11d4-4fdb-9762-ee44d52fe74d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-83d77c4c-0b9d-4371-ad2a-ac5f9ac9c161 req-9c49357a-9aef-4e83-be57-b9877bff1c28 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-deleted-5c91590c-ef72-4c8e-8b32-405d39bbed6f {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-83d77c4c-0b9d-4371-ad2a-ac5f9ac9c161 req-9c49357a-9aef-4e83-be57-b9877bff1c28 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-deleted-4c862e27-9d0e-4b9d-a4a3-d0d8f7656ab2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-83d77c4c-0b9d-4371-ad2a-ac5f9ac9c161 req-9c49357a-9aef-4e83-be57-b9877bff1c28 service nova] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Received event network-vif-deleted-eea6e247-33fe-41c7-82d5-58ffbf9187fc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-84d7f2e4-1827-4945-abc3-b6f861e41533 req-0f0c068d-af7c-48a0-a346-3886f8ac8888 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-changed-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-84d7f2e4-1827-4945-abc3-b6f861e41533 req-0f0c068d-af7c-48a0-a346-3886f8ac8888 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing instance network info cache due to event network-changed-47d653ec-9fa1-4929-bf59-ae48e06726b4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:47:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84d7f2e4-1827-4945-abc3-b6f861e41533 req-0f0c068d-af7c-48a0-a346-3886f8ac8888 service nova] Acquiring lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84d7f2e4-1827-4945-abc3-b6f861e41533 req-0f0c068d-af7c-48a0-a346-3886f8ac8888 service nova] Acquired lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-84d7f2e4-1827-4945-abc3-b6f861e41533 req-0f0c068d-af7c-48a0-a346-3886f8ac8888 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Refreshing network info cache for port 47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.volume.cinder [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Update attachment failed for attachment 4559cce2-c7f8-40ec-9fea-30e7c28c80d9. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bdb262f6-2fb3-4bd4-9d3f-0508df1d1365) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bdb262f6-2fb3-4bd4-9d3f-0508df1d1365)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bdb262f6-2fb3-4bd4-9d3f-0508df1d1365)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Traceback (most recent call last):
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/nova/nova/compute/manager.py", line 10846, in _error_out_instance_on_exception
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     yield
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/nova/nova/compute/manager.py", line 6378, in _finish_resize_helper
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     network_info = self._finish_resize(context, instance, migration,
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/nova/nova/compute/manager.py", line 6282, in _finish_resize
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     self._update_volume_attachments(context, instance, bdms)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     self.volume_api.attachment_update(
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     res = method(self, ctx, *args, **kwargs)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     with excutils.save_and_reraise_exception():
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     self.force_reraise()
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     raise self.value
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     context, '3.44', skip_version_check=True).attachments.update(
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     return method.func(obj, *args, **kwargs)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     resp = self._update('/attachments/%s' % id, body)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     return self._cs_request(url, 'PUT', **kwargs)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     return self.request(url, method, **kwargs)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080]     raise exceptions.from_response(resp, body)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bdb262f6-2fb3-4bd4-9d3f-0508df1d1365)
Dec 01 13:47:36 user nova-compute[75288]: ERROR nova.compute.manager [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] 
Dec 01 13:47:36 user nova-compute[75288]: INFO nova.compute.manager [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Dec 01 13:47:36 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Deleted allocation for migration 026c43db-a46f-495d-a500-7e7de874989c
Dec 01 13:47:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-84d7f2e4-1827-4945-abc3-b6f861e41533 req-0f0c068d-af7c-48a0-a346-3886f8ac8888 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updated VIF entry in instance network info cache for port 47d653ec-9fa1-4929-bf59-ae48e06726b4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:47:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-84d7f2e4-1827-4945-abc3-b6f861e41533 req-0f0c068d-af7c-48a0-a346-3886f8ac8888 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-84d7f2e4-1827-4945-abc3-b6f861e41533 req-0f0c068d-af7c-48a0-a346-3886f8ac8888 service nova] Releasing lock "refresh_cache-8541199a-393b-445d-8945-11fc3f9d0bd9" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:37 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:47:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:47:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:37 user nova-compute[75288]: INFO nova.compute.manager [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Successfully reverted task state from resize_finish on failure for instance.
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server [None req-73e5a996-4644-475c-aabd-870e3f580301 tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bdb262f6-2fb3-4bd4-9d3f-0508df1d1365)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6348, in finish_resize
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6345, in finish_resize
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6378, in _finish_resize_helper
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6282, in _finish_resize
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6212, in _update_volume_attachments
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bdb262f6-2fb3-4bd4-9d3f-0508df1d1365)
Dec 01 13:47:37 user nova-compute[75288]: ERROR oslo_messaging.rpc.server 
Dec 01 13:47:37 user nova-compute[75288]: INFO nova.compute.manager [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] [instance: 7834a8ee-1c0c-49e1-8b47-70ce3b64c702] Took 2.94 seconds to detach 3 volumes for instance.
Dec 01 13:47:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:38 user nova-compute[75288]: INFO nova.compute.manager [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Terminating instance
Dec 01 13:47:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:47:38 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Deleted allocations for instance 7834a8ee-1c0c-49e1-8b47-70ce3b64c702
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a5b8d046-7768-4e63-838f-d9aa3f3fcc02 tempest-TaggedBootDevicesTest_v242-1913742395 tempest-TaggedBootDevicesTest_v242-1913742395-project-member] Lock "7834a8ee-1c0c-49e1-8b47-70ce3b64c702" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.460s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-3fe344fb-f09d-4661-aa49-13159ffeb4f1 req-26f44fe6-94ae-4850-be40-350ce2495512 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3fe344fb-f09d-4661-aa49-13159ffeb4f1 req-26f44fe6-94ae-4850-be40-350ce2495512 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3fe344fb-f09d-4661-aa49-13159ffeb4f1 req-26f44fe6-94ae-4850-be40-350ce2495512 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3fe344fb-f09d-4661-aa49-13159ffeb4f1 req-26f44fe6-94ae-4850-be40-350ce2495512 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-3fe344fb-f09d-4661-aa49-13159ffeb4f1 req-26f44fe6-94ae-4850-be40-350ce2495512 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-unplugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-3fe344fb-f09d-4661-aa49-13159ffeb4f1 req-26f44fe6-94ae-4850-be40-350ce2495512 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-03bc604d-7409-4d15-b383-a07cbb2257fe req-78b108c1-500b-4d8f-8db0-eae426749f52 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-03bc604d-7409-4d15-b383-a07cbb2257fe req-78b108c1-500b-4d8f-8db0-eae426749f52 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-03bc604d-7409-4d15-b383-a07cbb2257fe req-78b108c1-500b-4d8f-8db0-eae426749f52 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-03bc604d-7409-4d15-b383-a07cbb2257fe req-78b108c1-500b-4d8f-8db0-eae426749f52 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-03bc604d-7409-4d15-b383-a07cbb2257fe req-78b108c1-500b-4d8f-8db0-eae426749f52 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-unplugged-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-03bc604d-7409-4d15-b383-a07cbb2257fe req-78b108c1-500b-4d8f-8db0-eae426749f52 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-35ce63be-f092-4ded-afef-aeffa88e5eeb for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-270a1388-e21b-4439-91be-25fdb17e9062 req-8a6f5e95-4702-4774-9599-fabc60127e12 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-270a1388-e21b-4439-91be-25fdb17e9062 req-8a6f5e95-4702-4774-9599-fabc60127e12 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-270a1388-e21b-4439-91be-25fdb17e9062 req-8a6f5e95-4702-4774-9599-fabc60127e12 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-270a1388-e21b-4439-91be-25fdb17e9062 req-8a6f5e95-4702-4774-9599-fabc60127e12 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-270a1388-e21b-4439-91be-25fdb17e9062 req-8a6f5e95-4702-4774-9599-fabc60127e12 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-unplugged-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-270a1388-e21b-4439-91be-25fdb17e9062 req-8a6f5e95-4702-4774-9599-fabc60127e12 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-965a693f-d1e1-455c-a9b5-645428548617 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "d34c97bf-d1a9-4c88-bdec-12156a546520" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "d34c97bf-d1a9-4c88-bdec-12156a546520" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:47:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Instance destroyed successfully.
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lazy-loading 'resources' on Instance uuid 8541199a-393b-445d-8945-11fc3f9d0bd9 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:7e:28,bridge_name='br-int',has_traffic_filtering=True,id=47d653ec-9fa1-4929-bf59-ae48e06726b4,network=Network(4d76c275-d734-4546-9496-9a86957e7231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d653ec-9f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:7e:28,bridge_name='br-int',has_traffic_filtering=True,id=47d653ec-9fa1-4929-bf59-ae48e06726b4,network=Network(4d76c275-d734-4546-9496-9a86957e7231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d653ec-9f') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47d653ec-9f, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:47:40 user nova-compute[75288]: INFO nova.compute.claims [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Claim successful on node user
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4247dc46-5fb6-4b76-a9b6-39320d5f0f2a) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: INFO os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:7e:28,bridge_name='br-int',has_traffic_filtering=True,id=47d653ec-9fa1-4929-bf59-ae48e06726b4,network=Network(4d76c275-d734-4546-9496-9a86957e7231),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d653ec-9f')
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:52:26,bridge_name='br-int',has_traffic_filtering=True,id=bfbfc658-3b20-4753-8473-2a21b94fc8f1,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfbfc658-3b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:52:26,bridge_name='br-int',has_traffic_filtering=True,id=bfbfc658-3b20-4753-8473-2a21b94fc8f1,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfbfc658-3b') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfbfc658-3b, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc0d1d67-b4b9-4efb-9e27-becd728c6aaa) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: INFO os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:52:26,bridge_name='br-int',has_traffic_filtering=True,id=bfbfc658-3b20-4753-8473-2a21b94fc8f1,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfbfc658-3b')
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2d:20,bridge_name='br-int',has_traffic_filtering=True,id=8b872961-dfca-481d-a5f8-716d1d3d26d2,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b872961-df') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2d:20,bridge_name='br-int',has_traffic_filtering=True,id=8b872961-dfca-481d-a5f8-716d1d3d26d2,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b872961-df') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b872961-df, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bd59d42-5d88-42fa-91c1-f0af2f8cc7bc) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: INFO os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2d:20,bridge_name='br-int',has_traffic_filtering=True,id=8b872961-dfca-481d-a5f8-716d1d3d26d2,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8b872961-df')
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=35ce63be-f092-4ded-afef-aeffa88e5eeb,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ce63be-f0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=35ce63be-f092-4ded-afef-aeffa88e5eeb,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ce63be-f0') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35ce63be-f0, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:40 user nova-compute[75288]: WARNING nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-47d653ec-9fa1-4929-bf59-ae48e06726b4 for instance with vm_state active and task_state deleting.
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-unplugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:40 user nova-compute[75288]: WARNING nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-bfbfc658-3b20-4753-8473-2a21b94fc8f1 for instance with vm_state active and task_state deleting.
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-unplugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:40 user nova-compute[75288]: WARNING nova.compute.manager [req-a9e56f98-9537-424b-be91-c8e807cef2cd req-0e531dc5-f067-46e6-8044-3f538c7beea0 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-8b872961-dfca-481d-a5f8-716d1d3d26d2 for instance with vm_state active and task_state deleting.
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c16fe3df-de40-49d5-a724-8c28db5c4515) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: INFO os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:f5:33,bridge_name='br-int',has_traffic_filtering=True,id=35ce63be-f092-4ded-afef-aeffa88e5eeb,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ce63be-f0')
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:c2:d7,bridge_name='br-int',has_traffic_filtering=True,id=71975ebb-9a52-41bd-b101-27e8c87b105b,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71975ebb-9a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c2:d7,bridge_name='br-int',has_traffic_filtering=True,id=71975ebb-9a52-41bd-b101-27e8c87b105b,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71975ebb-9a') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71975ebb-9a, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85a05055-99ea-4b8c-b4f6-0289fc708871) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:41 user nova-compute[75288]: INFO os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:c2:d7,bridge_name='br-int',has_traffic_filtering=True,id=71975ebb-9a52-41bd-b101-27e8c87b105b,network=Network(b930e191-f0c4-469a-8bec-0fa24edbf893),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71975ebb-9a')
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "address": "fa:16:3e:82:8d:7a", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2583bac-f8", "ovs_interfaceid": "b2583bac-f8d6-4dbd-ab70-e6086ea5c02a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:7a,bridge_name='br-int',has_traffic_filtering=True,id=b2583bac-f8d6-4dbd-ab70-e6086ea5c02a,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2583bac-f8') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:7a,bridge_name='br-int',has_traffic_filtering=True,id=b2583bac-f8d6-4dbd-ab70-e6086ea5c02a,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2583bac-f8') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2583bac-f8, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f07ea05-d3ce-4a10-a2d1-c1eef98892b9) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: INFO os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:8d:7a,bridge_name='br-int',has_traffic_filtering=True,id=b2583bac-f8d6-4dbd-ab70-e6086ea5c02a,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2583bac-f8')
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:44:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-936605216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-936605216',id=13,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7RCTG4loD4k9FOg87RVTvgvlRQne0MiMxaGhzWy5H2LVwgQRZC9mhHaAcltLpbVDtNadv3L6JOjPlsiQXpf6b3KbzK2C93ujbUWRUguWZ/3lgvy9kYfdavajSPI512pQ==',key_name='tempest-keypair-1394188012',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95bdefcd6dad4213a733b8ba90eb0c61',ramdisk_id='',reservation_id='r-6a7zk963',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-525104724',owner_user_name='tempest-TaggedBootDevicesTest-525104724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb0b77c33fae4ec6904a365da24cff8c',uuid=8541199a-393b-445d-8945-11fc3f9d0bd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converting VIF {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=965a693f-d1e1-455c-a9b5-645428548617,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965a693f-d1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=965a693f-d1e1-455c-a9b5-645428548617,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965a693f-d1') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap965a693f-d1, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7340525b-344e-4ca3-96e0-d317ca353630) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:47:41 user nova-compute[75288]: INFO os_vif [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:76:4f,bridge_name='br-int',has_traffic_filtering=True,id=965a693f-d1e1-455c-a9b5-645428548617,network=Network(2f8a7bed-d8c9-41c2-a031-342632289977),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap965a693f-d1')
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FaTSIwqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e038854-13bd-4199-bfde-28315527b239]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:47:41 user nova-compute[75288]: No targets found.
Dec 01 13:47:41 user nova-compute[75288]: iSNS:
Dec 01 13:47:41 user nova-compute[75288]: No targets found.
Dec 01 13:47:41 user nova-compute[75288]: STATIC:
Dec 01 13:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d
Dec 01 13:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:41 user nova-compute[75288]: FIRMWARE:
Dec 01 13:47:41 user nova-compute[75288]: No targets found.
Dec 01 13:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:47:41 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:47:41 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.network.neutron [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[224234b0-1098-4256-8178-50bf178e0be6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:41 user nova-compute[75288]: WARNING nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-35ce63be-f092-4ded-afef-aeffa88e5eeb for instance with vm_state active and task_state deleting.
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-unplugged-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-71975ebb-9a52-41bd-b101-27e8c87b105b for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:41 user nova-compute[75288]: WARNING nova.compute.manager [req-234b6c43-9280-4192-a8bb-d7b41e984563 req-0de165f7-6db7-453e-a96e-7502a4de28f8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-71975ebb-9a52-41bd-b101-27e8c87b105b for instance with vm_state active and task_state deleting.
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e171a4f6-6321-4fa7-997b-3abc595c33d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e70f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d'): ({'sdk'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Removing single pathed devices sdk {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.policy [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab6a9e09550e42edac3c1e8a9112fbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1120cc4cc3d8458aaf5755a500e994c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5391dee4-128a-42da-9c5d-c9ce66a3d973]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: INFO nova.virt.block_device [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Booting with volume 226a4e4e-f2e4-4dea-80ac-d48d9f8749c1 at /dev/vda
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2d1d5d-8e07-46a5-bfef-1c147008cc8e]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Flushing IO for device /dev/sdk {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[24baf4ca-fca8-4d5b-a1cb-61a9ebcf7d12]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.utils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.069s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff46f08-a96e-4e29-91f4-87272fdf227b]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] SCSI volumes sdk have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ce98f-632d-434c-b06d-ac07dc23de50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[08799d6a-b6a5-445b-9672-216813c6d3a7]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.039s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ac3814-21cd-4258-b46a-aed833ccd517]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd51000f-8d61-4317-a0dd-72a83c2c8f0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b29e9e-ab75-403d-a18a-d891edb5ea26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3631523f-95ff-4bc9-b312-cfac031348ef]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d, portal: 172.16.0.220,3260]
Dec 01 13:47:41 user nova-compute[75288]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:47:41 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f87128-e0b4-472a-ae91-52c4333cc50d]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.utils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Updating existing volume attachment record: a95c71cb-53ae-43f5-a457-26da5199a03f {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fa53c26-3d5e-4577-bfd4-dc8063df793d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad05790-7e4b-4e33-a5ae-b548010a88d2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.481s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== disconnect_volume: return (483ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DujsSWUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d252ab47-f924-4c5b-a674-afbfeb3206ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:47:41 user nova-compute[75288]: No targets found.
Dec 01 13:47:41 user nova-compute[75288]: iSNS:
Dec 01 13:47:41 user nova-compute[75288]: No targets found.
Dec 01 13:47:41 user nova-compute[75288]: STATIC:
Dec 01 13:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21
Dec 01 13:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:47:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:41 user nova-compute[75288]: FIRMWARE:
Dec 01 13:47:41 user nova-compute[75288]: No targets found.
Dec 01 13:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:47:41 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:47:41 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d555bf6b-6ee4-46bb-94f6-bdba3255c34a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e498f6-00ad-4022-ac55-a9950fee7fc4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:41 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc27f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f246f2c1-afd0-42a9-9875-ab2753b20c05]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35c6a46-9344-43b6-a736-7758e1915ac4]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[034cbd9a-4612-4595-a1a5-4df0c7e983c3]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a761395-f297-4190-81cf-5b60b8bd636a req-4e80db8e-d22b-4944-90cc-d9e09c789929 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a761395-f297-4190-81cf-5b60b8bd636a req-4e80db8e-d22b-4944-90cc-d9e09c789929 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a761395-f297-4190-81cf-5b60b8bd636a req-4e80db8e-d22b-4944-90cc-d9e09c789929 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a761395-f297-4190-81cf-5b60b8bd636a req-4e80db8e-d22b-4944-90cc-d9e09c789929 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a761395-f297-4190-81cf-5b60b8bd636a req-4e80db8e-d22b-4944-90cc-d9e09c789929 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:41 user nova-compute[75288]: WARNING nova.compute.manager [req-2a761395-f297-4190-81cf-5b60b8bd636a req-4e80db8e-d22b-4944-90cc-d9e09c789929 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-965a693f-d1e1-455c-a9b5-645428548617 for instance with vm_state active and task_state deleting.
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8c7504-0ad3-41d2-831a-d7deec74c888]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c889b5e-208d-4e87-9f38-f45427490186]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG nova.network.neutron [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Successfully created port: 016b84b7-88ec-4d06-86e6-ef33bef7e5ca {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c7b390-1fd1-4bd2-91fd-4f89462367fc]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21, portal: 172.16.0.220,3260]
Dec 01 13:47:41 user nova-compute[75288]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40010598-b7e8-4a05-bcaa-6291feb5fe21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b7cede-feea-45b6-b99c-cf300daa20a1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== disconnect_volume: return (352ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TnyfOHpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:47:42 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48bec60-a065-425a-8f40-5d406fff4fb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:47:42 user nova-compute[75288]: No targets found.
Dec 01 13:47:42 user nova-compute[75288]: iSNS:
Dec 01 13:47:42 user nova-compute[75288]: No targets found.
Dec 01 13:47:42 user nova-compute[75288]: STATIC:
Dec 01 13:47:42 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c
Dec 01 13:47:42 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:42 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:42 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:47:42 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:47:42 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:47:42 user nova-compute[75288]: FIRMWARE:
Dec 01 13:47:42 user nova-compute[75288]: No targets found.
Dec 01 13:47:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:47:42 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:47:42 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7358d9b3-7f2f-4770-8bbc-5b848b2c5202]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b340a323-1dd6-4c49-8fbf-12e20663e847]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:42 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c (non-flash)
Dec 01 13:47:42 user nova-compute[75288]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:47:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e3b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c'): ({'sdj'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Removing single pathed devices sdj {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdc227-3161-4a9d-99aa-4ba156215017]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[497a3d36-9dd4-4d6e-9f2b-34819fbb84d8]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Flushing IO for device /dev/sdj {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57340f2-6b3d-4e2d-9996-3dbf1af2ed8c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.075s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6e4b51-8daa-431a-8605-7a77a8d618c7]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] SCSI volumes sdj have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7fbaa2-a5be-480e-8d85-e987721b9701]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --logout" returned: 0 in 0.183s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fda56c0-a3da-4914-b558-c5dc9f6afede]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c, portal: 172.16.0.220,3260]
Dec 01 13:47:42 user nova-compute[75288]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c, portal: 172.16.0.220,3260] successful.
Dec 01 13:47:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e30106-6e40-4983-9b5f-35142952476c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67b962a-866f-4f37-bd46-6d8e6f0e37bd]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] <== disconnect_volume: return (486ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:47:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Deleting instance files /opt/stack/data/nova/instances/8541199a-393b-445d-8945-11fc3f9d0bd9_del
Dec 01 13:47:42 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Deletion of /opt/stack/data/nova/instances/8541199a-393b-445d-8945-11fc3f9d0bd9_del complete
Dec 01 13:47:42 user nova-compute[75288]: INFO nova.compute.manager [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Took 4.12 seconds to destroy the instance on the hypervisor.
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Successfully updated port: 016b84b7-88ec-4d06-86e6-ef33bef7e5ca {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "refresh_cache-d34c97bf-d1a9-4c88-bdec-12156a546520" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquired lock "refresh_cache-d34c97bf-d1a9-4c88-bdec-12156a546520" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:47:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-unplugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-unplugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] Acquiring lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] No waiting events found dispatching network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:43 user nova-compute[75288]: WARNING nova.compute.manager [req-ffc43a94-d5da-4120-9c27-6abefff07269 req-27c866ed-f307-4484-b090-b7f49563b6d8 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received unexpected event network-vif-plugged-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a for instance with vm_state active and task_state deleting.
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.network.neutron [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Updating instance_info_cache with network_info: [{"id": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "address": "fa:16:3e:3c:1d:31", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016b84b7-88", "ovs_interfaceid": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Releasing lock "refresh_cache-d34c97bf-d1a9-4c88-bdec-12156a546520" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Instance network_info: |[{"id": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "address": "fa:16:3e:3c:1d:31", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016b84b7-88", "ovs_interfaceid": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-c8bbba27-5336-4d6e-b576-c0f3509655ac req-4cd94528-0a0a-4272-8e22-061cb9d2b272 service nova] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Received event network-changed-016b84b7-88ec-4d06-86e6-ef33bef7e5ca {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-c8bbba27-5336-4d6e-b576-c0f3509655ac req-4cd94528-0a0a-4272-8e22-061cb9d2b272 service nova] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Refreshing instance network info cache due to event network-changed-016b84b7-88ec-4d06-86e6-ef33bef7e5ca. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c8bbba27-5336-4d6e-b576-c0f3509655ac req-4cd94528-0a0a-4272-8e22-061cb9d2b272 service nova] Acquiring lock "refresh_cache-d34c97bf-d1a9-4c88-bdec-12156a546520" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c8bbba27-5336-4d6e-b576-c0f3509655ac req-4cd94528-0a0a-4272-8e22-061cb9d2b272 service nova] Acquired lock "refresh_cache-d34c97bf-d1a9-4c88-bdec-12156a546520" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.network.neutron [req-c8bbba27-5336-4d6e-b576-c0f3509655ac req-4cd94528-0a0a-4272-8e22-061cb9d2b272 service nova] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Refreshing network info cache for port 016b84b7-88ec-4d06-86e6-ef33bef7e5ca {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.network.neutron [req-c8bbba27-5336-4d6e-b576-c0f3509655ac req-4cd94528-0a0a-4272-8e22-061cb9d2b272 service nova] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Updated VIF entry in instance network info cache for port 016b84b7-88ec-4d06-86e6-ef33bef7e5ca. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG nova.network.neutron [req-c8bbba27-5336-4d6e-b576-c0f3509655ac req-4cd94528-0a0a-4272-8e22-061cb9d2b272 service nova] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Updating instance_info_cache with network_info: [{"id": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "address": "fa:16:3e:3c:1d:31", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016b84b7-88", "ovs_interfaceid": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c8bbba27-5336-4d6e-b576-c0f3509655ac req-4cd94528-0a0a-4272-8e22-061cb9d2b272 service nova] Releasing lock "refresh_cache-d34c97bf-d1a9-4c88-bdec-12156a546520" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-556640cd-f9e4-43f7-8470-ba985b5028b2 req-6427b361-cb81-49b2-a0e2-d2340d4df2ac service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-deleted-b2583bac-f8d6-4dbd-ab70-e6086ea5c02a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:45 user nova-compute[75288]: INFO nova.compute.manager [req-556640cd-f9e4-43f7-8470-ba985b5028b2 req-6427b361-cb81-49b2-a0e2-d2340d4df2ac service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Neutron deleted interface b2583bac-f8d6-4dbd-ab70-e6086ea5c02a; detaching it from the instance and deleting it from the info cache
Dec 01 13:47:45 user nova-compute[75288]: DEBUG nova.network.neutron [req-556640cd-f9e4-43f7-8470-ba985b5028b2 req-6427b361-cb81-49b2-a0e2-d2340d4df2ac service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "address": "fa:16:3e:d7:f5:33", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ce63be-f0", "ovs_interfaceid": "35ce63be-f092-4ded-afef-aeffa88e5eeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-556640cd-f9e4-43f7-8470-ba985b5028b2 req-6427b361-cb81-49b2-a0e2-d2340d4df2ac service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Detach interface failed, port_id=b2583bac-f8d6-4dbd-ab70-e6086ea5c02a, reason: Instance 8541199a-393b-445d-8945-11fc3f9d0bd9 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:47:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-deleted-35ce63be-f092-4ded-afef-aeffa88e5eeb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:47 user nova-compute[75288]: INFO nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Neutron deleted interface 35ce63be-f092-4ded-afef-aeffa88e5eeb; detaching it from the instance and deleting it from the info cache
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "965a693f-d1e1-455c-a9b5-645428548617", "address": "fa:16:3e:03:76:4f", "network": {"id": "2f8a7bed-d8c9-41c2-a031-342632289977", "bridge": "br-int", "label": "tempest-device-tagging-net2-1431888845", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap965a693f-d1", "ovs_interfaceid": "965a693f-d1e1-455c-a9b5-645428548617", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Detach interface failed, port_id=35ce63be-f092-4ded-afef-aeffa88e5eeb, reason: Instance 8541199a-393b-445d-8945-11fc3f9d0bd9 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-deleted-965a693f-d1e1-455c-a9b5-645428548617 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:47 user nova-compute[75288]: INFO nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Neutron deleted interface 965a693f-d1e1-455c-a9b5-645428548617; detaching it from the instance and deleting it from the info cache
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "address": "fa:16:3e:8e:7e:28", "network": {"id": "4d76c275-d734-4546-9496-9a86957e7231", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-395644293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d653ec-9f", "ovs_interfaceid": "47d653ec-9fa1-4929-bf59-ae48e06726b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Detach interface failed, port_id=965a693f-d1e1-455c-a9b5-645428548617, reason: Instance 8541199a-393b-445d-8945-11fc3f9d0bd9 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-deleted-47d653ec-9fa1-4929-bf59-ae48e06726b4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:47 user nova-compute[75288]: INFO nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Neutron deleted interface 47d653ec-9fa1-4929-bf59-ae48e06726b4; detaching it from the instance and deleting it from the info cache
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [{"id": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "address": "fa:16:3e:1c:52:26", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfbfc658-3b", "ovs_interfaceid": "bfbfc658-3b20-4753-8473-2a21b94fc8f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "address": "fa:16:3e:f0:2d:20", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b872961-df", "ovs_interfaceid": "8b872961-dfca-481d-a5f8-716d1d3d26d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71975ebb-9a52-41bd-b101-27e8c87b105b", "address": "fa:16:3e:11:c2:d7", "network": {"id": "b930e191-f0c4-469a-8bec-0fa24edbf893", "bridge": "br-int", "label": "tempest-device-tagging-net1-273428734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "95bdefcd6dad4213a733b8ba90eb0c61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71975ebb-9a", "ovs_interfaceid": "71975ebb-9a52-41bd-b101-27e8c87b105b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-13426a3a-0198-4436-8a20-fb15da33bcdc req-81332a0e-5664-4b5a-83e3-2b5e30d207db service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Detach interface failed, port_id=47d653ec-9fa1-4929-bf59-ae48e06726b4, reason: Instance 8541199a-393b-445d-8945-11fc3f9d0bd9 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:47:47 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:47 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Took 5.02 seconds to deallocate network for instance.
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.volume.cinder [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Update attachment failed for attachment a95c71cb-53ae-43f5-a457-26da5199a03f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-47ffb868-01d9-475f-b7e9-9b6ca8043a58) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-47ffb868-01d9-475f-b7e9-9b6ca8043a58)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-47ffb868-01d9-475f-b7e9-9b6ca8043a58)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Traceback (most recent call last):
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     driver_block_device.attach_block_devices(
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     _log_and_attach(device)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     bdm.attach(*attach_args, **attach_kwargs)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     ret_val = method(obj, context, *args, **kwargs)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     self._do_attach(context, instance, volume, volume_api,
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     self._volume_attach(context, volume, connector, instance,
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     connection_info = volume_api.attachment_update(
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     res = method(self, ctx, *args, **kwargs)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     with excutils.save_and_reraise_exception():
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     self.force_reraise()
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     raise self.value
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     context, '3.44', skip_version_check=True).attachments.update(
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     return method.func(obj, *args, **kwargs)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     resp = self._update('/attachments/%s' % id, body)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     return self._cs_request(url, 'PUT', **kwargs)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     return self.request(url, method, **kwargs)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520]     raise exceptions.from_response(resp, body)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-47ffb868-01d9-475f-b7e9-9b6ca8043a58)
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] 
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.compute.claims [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Aborting claim: <nova.compute.claims.Claim object at 0x7fdbbc3ad390> {{(pid=75288) abort /opt/stack/nova/nova/compute/claims.py:84}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-8a755a29-6f20-4682-a2bf-1147a33ca2fc req-6935d87b-fd85-4bc3-8bf3-22d08c55d0e2 service nova] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Received event network-vif-deleted-71975ebb-9a52-41bd-b101-27e8c87b105b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.571s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Build of instance d34c97bf-d1a9-4c88-bdec-12156a546520 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-47ffb868-01d9-475f-b7e9-9b6ca8043a58) {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.compute.utils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Build of instance d34c97bf-d1a9-4c88-bdec-12156a546520 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75288) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Dec 01 13:47:49 user nova-compute[75288]: ERROR nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Build of instance d34c97bf-d1a9-4c88-bdec-12156a546520 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-47ffb868-01d9-475f-b7e9-9b6ca8043a58): nova.exception.BuildAbortException: Build of instance d34c97bf-d1a9-4c88-bdec-12156a546520 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-47ffb868-01d9-475f-b7e9-9b6ca8043a58)
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Unplugging VIFs for instance {{(pid=75288) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1833783501',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1833783501',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1833783501',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3QXgGhWtIBSAp2D8OM7GarryjqvDZyRl6G2wDK/O7BA73T0H/0fYQhfCCcu1OWtqmRrMwa13I7/vssR4cqB1q00y3dxmHztz5sddWNXAPhOK3E+ZjrV50NQt4wMncyQA==',key_name='tempest-keypair-1924980681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-gv5f5e4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:47:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=d34c97bf-d1a9-4c88-bdec-12156a546520,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "address": "fa:16:3e:3c:1d:31", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016b84b7-88", "ovs_interfaceid": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "address": "fa:16:3e:3c:1d:31", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap016b84b7-88", "ovs_interfaceid": "016b84b7-88ec-4d06-86e6-ef33bef7e5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:31,bridge_name='br-int',has_traffic_filtering=True,id=016b84b7-88ec-4d06-86e6-ef33bef7e5ca,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016b84b7-88') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG os_vif [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:31,bridge_name='br-int',has_traffic_filtering=True,id=016b84b7-88ec-4d06-86e6-ef33bef7e5ca,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016b84b7-88') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap016b84b7-88, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:47:49 user nova-compute[75288]: INFO os_vif [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:31,bridge_name='br-int',has_traffic_filtering=True,id=016b84b7-88ec-4d06-86e6-ef33bef7e5ca,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap016b84b7-88')
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Unplugged VIFs for instance {{(pid=75288) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:47:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:47:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:50 user nova-compute[75288]: INFO nova.compute.manager [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] [instance: 8541199a-393b-445d-8945-11fc3f9d0bd9] Took 2.88 seconds to detach 3 volumes for instance.
Dec 01 13:47:50 user nova-compute[75288]: DEBUG nova.network.neutron [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:50 user nova-compute[75288]: INFO nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Took 0.88 seconds to deallocate network for instance.
Dec 01 13:47:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Detaching volume: 226a4e4e-f2e4-4dea-80ac-d48d9f8749c1 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Dec 01 13:47:50 user nova-compute[75288]: INFO nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Detaching volume 226a4e4e-f2e4-4dea-80ac-d48d9f8749c1
Dec 01 13:47:50 user nova-compute[75288]: ERROR nova.virt.block_device [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Unable to call for a driver detach of volume 226a4e4e-f2e4-4dea-80ac-d48d9f8749c1 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance d34c97bf-d1a9-4c88-bdec-12156a546520 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-47ffb868-01d9-475f-b7e9-9b6ca8043a58)
Dec 01 13:47:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: d34c97bf-d1a9-4c88-bdec-12156a546520] Deleting volume: 226a4e4e-f2e4-4dea-80ac-d48d9f8749c1 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 13:47:50 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:47:50 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:47:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:51 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Deleted allocations for instance 8541199a-393b-445d-8945-11fc3f9d0bd9
Dec 01 13:47:51 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Deleted allocations for instance d34c97bf-d1a9-4c88-bdec-12156a546520
Dec 01 13:47:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-18677f46-4cfd-40d7-b487-17819e024926 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "d34c97bf-d1a9-4c88-bdec-12156a546520" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.649s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d6ca49a0-562e-4709-b6aa-2fe0da44ba2f tempest-TaggedBootDevicesTest-525104724 tempest-TaggedBootDevicesTest-525104724-project-member] Lock "8541199a-393b-445d-8945-11fc3f9d0bd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.648s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:56 user nova-compute[75288]: INFO nova.compute.manager [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Rescuing
Dec 01 13:47:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:47:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquired lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:47:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:47:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:47:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Releasing lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:47:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-9c3d8b3c-9f6e-4c09-b568-9e0c955fbc98 req-9edc4c1c-86a9-44ca-b182-ed8188df632e service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9c3d8b3c-9f6e-4c09-b568-9e0c955fbc98 req-9edc4c1c-86a9-44ca-b182-ed8188df632e service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9c3d8b3c-9f6e-4c09-b568-9e0c955fbc98 req-9edc4c1c-86a9-44ca-b182-ed8188df632e service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9c3d8b3c-9f6e-4c09-b568-9e0c955fbc98 req-9edc4c1c-86a9-44ca-b182-ed8188df632e service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-9c3d8b3c-9f6e-4c09-b568-9e0c955fbc98 req-9edc4c1c-86a9-44ca-b182-ed8188df632e service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:47:58 user nova-compute[75288]: WARNING nova.compute.manager [req-9c3d8b3c-9f6e-4c09-b568-9e0c955fbc98 req-9edc4c1c-86a9-44ca-b182-ed8188df632e service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state active and task_state rescuing.
Dec 01 13:47:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance destroyed successfully.
Dec 01 13:47:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Attempting rescue
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 13:47:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Creating image(s)
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'trusted_certs' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue" returned: 0 in 0.054s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'migration_context' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<57c16213-db78-4d88-8171-260254bc943a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Start _get_guest_xml network_info=[{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:5c:3c:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'resources' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<57c16213-db78-4d88-8171-260254bc943a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'numa_topology' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<57c16213-db78-4d88-8171-260254bc943a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:47:58 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'vcpu_model' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<57c16213-db78-4d88-8171-260254bc943a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2015631158',display_name='tempest-ServerRescueNegativeTestJSON-server-2015631158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2015631158',id=2,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-pw09zhis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:43:29Z,user_data=None,user_id='cad75165194843718ebc8b886ab3b6b7',uuid=57c16213-db78-4d88-8171-260254bc943a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:5c:3c:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:5c:3c:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:3c:f3,bridge_name='br-int',has_traffic_filtering=True,id=8805c728-e19f-4972-95cc-3873e12010d0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8805c728-e1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'pci_devices' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<57c16213-db78-4d88-8171-260254bc943a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:47:58 user nova-compute[75288]:   <uuid>57c16213-db78-4d88-8171-260254bc943a</uuid>
Dec 01 13:47:58 user nova-compute[75288]:   <name>instance-00000002</name>
Dec 01 13:47:58 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:47:58 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:47:58 user nova-compute[75288]:   <metadata>
Dec 01 13:47:58 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:47:58 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:47:58 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2015631158</nova:name>
Dec 01 13:47:58 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:47:58</nova:creationTime>
Dec 01 13:47:58 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:47:58 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:47:58 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:47:58 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:47:58 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:47:58 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:47:58 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:47:58 user nova-compute[75288]:       <nova:owner>
Dec 01 13:47:58 user nova-compute[75288]:         <nova:user uuid="cad75165194843718ebc8b886ab3b6b7">tempest-ServerRescueNegativeTestJSON-1340015149-project-member</nova:user>
Dec 01 13:47:58 user nova-compute[75288]:         <nova:project uuid="a5854339bf9c4f3db4a3bf2c65ddc344">tempest-ServerRescueNegativeTestJSON-1340015149</nova:project>
Dec 01 13:47:58 user nova-compute[75288]:       </nova:owner>
Dec 01 13:47:58 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:47:58 user nova-compute[75288]:       <nova:ports>
Dec 01 13:47:58 user nova-compute[75288]:         <nova:port uuid="8805c728-e19f-4972-95cc-3873e12010d0">
Dec 01 13:47:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 13:47:58 user nova-compute[75288]:         </nova:port>
Dec 01 13:47:58 user nova-compute[75288]:       </nova:ports>
Dec 01 13:47:58 user nova-compute[75288]:     </nova:instance>
Dec 01 13:47:58 user nova-compute[75288]:   </metadata>
Dec 01 13:47:58 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:47:58 user nova-compute[75288]:     <system>
Dec 01 13:47:58 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:47:58 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:47:58 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:47:58 user nova-compute[75288]:       <entry name="serial">57c16213-db78-4d88-8171-260254bc943a</entry>
Dec 01 13:47:58 user nova-compute[75288]:       <entry name="uuid">57c16213-db78-4d88-8171-260254bc943a</entry>
Dec 01 13:47:58 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:47:58 user nova-compute[75288]:     </system>
Dec 01 13:47:58 user nova-compute[75288]:   </sysinfo>
Dec 01 13:47:58 user nova-compute[75288]:   <os>
Dec 01 13:47:58 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:47:58 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:47:58 user nova-compute[75288]:   </os>
Dec 01 13:47:58 user nova-compute[75288]:   <features>
Dec 01 13:47:58 user nova-compute[75288]:     <acpi/>
Dec 01 13:47:58 user nova-compute[75288]:     <apic/>
Dec 01 13:47:58 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:47:58 user nova-compute[75288]:   </features>
Dec 01 13:47:58 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:47:58 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:47:58 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:47:58 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:47:58 user nova-compute[75288]:   </clock>
Dec 01 13:47:58 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:47:58 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:47:58 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:47:58 user nova-compute[75288]:   </cpu>
Dec 01 13:47:58 user nova-compute[75288]:   <devices>
Dec 01 13:47:58 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:47:58 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:47:58 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue"/>
Dec 01 13:47:58 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:47:58 user nova-compute[75288]:     </disk>
Dec 01 13:47:58 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:47:58 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:47:58 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk"/>
Dec 01 13:47:58 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 13:47:58 user nova-compute[75288]:     </disk>
Dec 01 13:47:58 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:47:58 user nova-compute[75288]:       <mac address="fa:16:3e:5c:3c:f3"/>
Dec 01 13:47:58 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:47:58 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:47:58 user nova-compute[75288]:       <target dev="tap8805c728-e1"/>
Dec 01 13:47:58 user nova-compute[75288]:     </interface>
Dec 01 13:47:58 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:47:58 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/console.log" append="off"/>
Dec 01 13:47:58 user nova-compute[75288]:     </serial>
Dec 01 13:47:58 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:47:58 user nova-compute[75288]:     <video>
Dec 01 13:47:58 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:47:58 user nova-compute[75288]:     </video>
Dec 01 13:47:58 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:47:58 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:47:58 user nova-compute[75288]:     </rng>
Dec 01 13:47:58 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:47:58 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:47:58 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:47:58 user nova-compute[75288]:     </memballoon>
Dec 01 13:47:58 user nova-compute[75288]:   </devices>
Dec 01 13:47:58 user nova-compute[75288]: </domain>
Dec 01 13:47:58 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:47:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance destroyed successfully.
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No VIF found with MAC fa:16:3e:5c:3c:f3, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:47:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:47:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:47:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:47:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:47:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:47:59 user nova-compute[75288]: INFO nova.compute.claims [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Claim successful on node user
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:48:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:48:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Creating image(s)
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "/opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "/opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "/opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-e94f5b19-0fce-4648-b8ed-b41e1cae1884 req-bd465f44-b172-4171-bf0d-e2aa9d92886e service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e94f5b19-0fce-4648-b8ed-b41e1cae1884 req-bd465f44-b172-4171-bf0d-e2aa9d92886e service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e94f5b19-0fce-4648-b8ed-b41e1cae1884 req-bd465f44-b172-4171-bf0d-e2aa9d92886e service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e94f5b19-0fce-4648-b8ed-b41e1cae1884 req-bd465f44-b172-4171-bf0d-e2aa9d92886e service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-e94f5b19-0fce-4648-b8ed-b41e1cae1884 req-bd465f44-b172-4171-bf0d-e2aa9d92886e service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:00 user nova-compute[75288]: WARNING nova.compute.manager [req-e94f5b19-0fce-4648-b8ed-b41e1cae1884 req-bd465f44-b172-4171-bf0d-e2aa9d92886e service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state active and task_state rescuing.
Dec 01 13:48:00 user nova-compute[75288]: DEBUG nova.policy [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69266afe5e404e259d679d7498f99faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6b677b10d14d63984895b4cfbdad4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.233s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk 1073741824" returned: 0 in 0.056s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Cannot resize image /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Ensure instance console log exists: /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Successfully created port: aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:48:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1d3167c3-ed66-4461-9339-d27c1b90220f tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Successfully updated port: aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquired lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-45d94917-d893-4ba3-9cf2-a196666dbd4b req-ea22b869-66f8-4fc3-ac63-7aab42d7423e service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received event network-changed-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-45d94917-d893-4ba3-9cf2-a196666dbd4b req-ea22b869-66f8-4fc3-ac63-7aab42d7423e service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Refreshing instance network info cache due to event network-changed-aa6649ab-bb65-489c-b81c-53f25e55b510. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45d94917-d893-4ba3-9cf2-a196666dbd4b req-ea22b869-66f8-4fc3-ac63-7aab42d7423e service nova] Acquiring lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:02 user nova-compute[75288]: WARNING nova.compute.manager [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state rescued and task_state None.
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:02 user nova-compute[75288]: WARNING nova.compute.manager [req-134b2acc-612f-43e3-8235-183aaba916fc req-1869565f-c731-4132-9d80-c3082041091f service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state rescued and task_state None.
Dec 01 13:48:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updating instance_info_cache with network_info: [{"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Releasing lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Instance network_info: |[{"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45d94917-d893-4ba3-9cf2-a196666dbd4b req-ea22b869-66f8-4fc3-ac63-7aab42d7423e service nova] Acquired lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.network.neutron [req-45d94917-d893-4ba3-9cf2-a196666dbd4b req-ea22b869-66f8-4fc3-ac63-7aab42d7423e service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Refreshing network info cache for port aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Start _get_guest_xml network_info=[{"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:48:03 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:03 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1858549183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1858549183',id=17,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-zfefft3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:00Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=876c78f2-a975-49ea-9f97-cdca86cc1c51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=aa6649ab-bb65-489c-b81c-53f25e55b510,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6649ab-bb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'pci_devices' on Instance uuid 876c78f2-a975-49ea-9f97-cdca86cc1c51 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:48:03 user nova-compute[75288]:   <uuid>876c78f2-a975-49ea-9f97-cdca86cc1c51</uuid>
Dec 01 13:48:03 user nova-compute[75288]:   <name>instance-00000011</name>
Dec 01 13:48:03 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:48:03 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:48:03 user nova-compute[75288]:   <metadata>
Dec 01 13:48:03 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:48:03 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:48:03 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1858549183</nova:name>
Dec 01 13:48:03 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:48:03</nova:creationTime>
Dec 01 13:48:03 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:48:03 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:48:03 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:48:03 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:48:03 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:48:03 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:48:03 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:48:03 user nova-compute[75288]:       <nova:owner>
Dec 01 13:48:03 user nova-compute[75288]:         <nova:user uuid="69266afe5e404e259d679d7498f99faa">tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member</nova:user>
Dec 01 13:48:03 user nova-compute[75288]:         <nova:project uuid="2e6b677b10d14d63984895b4cfbdad4b">tempest-ServerBootFromVolumeStableRescueTest-64531845</nova:project>
Dec 01 13:48:03 user nova-compute[75288]:       </nova:owner>
Dec 01 13:48:03 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:48:03 user nova-compute[75288]:       <nova:ports>
Dec 01 13:48:03 user nova-compute[75288]:         <nova:port uuid="aa6649ab-bb65-489c-b81c-53f25e55b510">
Dec 01 13:48:03 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 01 13:48:03 user nova-compute[75288]:         </nova:port>
Dec 01 13:48:03 user nova-compute[75288]:       </nova:ports>
Dec 01 13:48:03 user nova-compute[75288]:     </nova:instance>
Dec 01 13:48:03 user nova-compute[75288]:   </metadata>
Dec 01 13:48:03 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:48:03 user nova-compute[75288]:     <system>
Dec 01 13:48:03 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:48:03 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:48:03 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:48:03 user nova-compute[75288]:       <entry name="serial">876c78f2-a975-49ea-9f97-cdca86cc1c51</entry>
Dec 01 13:48:03 user nova-compute[75288]:       <entry name="uuid">876c78f2-a975-49ea-9f97-cdca86cc1c51</entry>
Dec 01 13:48:03 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:48:03 user nova-compute[75288]:     </system>
Dec 01 13:48:03 user nova-compute[75288]:   </sysinfo>
Dec 01 13:48:03 user nova-compute[75288]:   <os>
Dec 01 13:48:03 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:48:03 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:48:03 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:48:03 user nova-compute[75288]:   </os>
Dec 01 13:48:03 user nova-compute[75288]:   <features>
Dec 01 13:48:03 user nova-compute[75288]:     <acpi/>
Dec 01 13:48:03 user nova-compute[75288]:     <apic/>
Dec 01 13:48:03 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:48:03 user nova-compute[75288]:   </features>
Dec 01 13:48:03 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:48:03 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:48:03 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:48:03 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:48:03 user nova-compute[75288]:   </clock>
Dec 01 13:48:03 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:48:03 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:48:03 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:48:03 user nova-compute[75288]:   </cpu>
Dec 01 13:48:03 user nova-compute[75288]:   <devices>
Dec 01 13:48:03 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:48:03 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:48:03 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk"/>
Dec 01 13:48:03 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:48:03 user nova-compute[75288]:     </disk>
Dec 01 13:48:03 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:48:03 user nova-compute[75288]:       <mac address="fa:16:3e:8e:ae:c8"/>
Dec 01 13:48:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:03 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:48:03 user nova-compute[75288]:       <target dev="tapaa6649ab-bb"/>
Dec 01 13:48:03 user nova-compute[75288]:     </interface>
Dec 01 13:48:03 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:48:03 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/console.log" append="off"/>
Dec 01 13:48:03 user nova-compute[75288]:     </serial>
Dec 01 13:48:03 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:48:03 user nova-compute[75288]:     <video>
Dec 01 13:48:03 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:03 user nova-compute[75288]:     </video>
Dec 01 13:48:03 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:48:03 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:48:03 user nova-compute[75288]:     </rng>
Dec 01 13:48:03 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:48:03 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:48:03 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:48:03 user nova-compute[75288]:     </memballoon>
Dec 01 13:48:03 user nova-compute[75288]:   </devices>
Dec 01 13:48:03 user nova-compute[75288]: </domain>
Dec 01 13:48:03 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1858549183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1858549183',id=17,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-zfefft3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:00Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=876c78f2-a975-49ea-9f97-cdca86cc1c51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=aa6649ab-bb65-489c-b81c-53f25e55b510,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6649ab-bb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG os_vif [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=aa6649ab-bb65-489c-b81c-53f25e55b510,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6649ab-bb') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44505745-b1c5-5aea-9205-0da7ac15d953', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa6649ab-bb, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa6649ab-bb, col_values=(('qos', UUID('8b2d7900-f6eb-407b-8973-d078e35b09ae')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa6649ab-bb, col_values=(('external_ids', {'iface-id': 'aa6649ab-bb65-489c-b81c-53f25e55b510', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:ae:c8', 'vm-uuid': '876c78f2-a975-49ea-9f97-cdca86cc1c51'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:03 user nova-compute[75288]: INFO os_vif [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=aa6649ab-bb65-489c-b81c-53f25e55b510,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6649ab-bb')
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:48:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No VIF found with MAC fa:16:3e:8e:ae:c8, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:48:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-45d94917-d893-4ba3-9cf2-a196666dbd4b req-ea22b869-66f8-4fc3-ac63-7aab42d7423e service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updated VIF entry in instance network info cache for port aa6649ab-bb65-489c-b81c-53f25e55b510. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:48:04 user nova-compute[75288]: DEBUG nova.network.neutron [req-45d94917-d893-4ba3-9cf2-a196666dbd4b req-ea22b869-66f8-4fc3-ac63-7aab42d7423e service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updating instance_info_cache with network_info: [{"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45d94917-d893-4ba3-9cf2-a196666dbd4b req-ea22b869-66f8-4fc3-ac63-7aab42d7423e service nova] Releasing lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:48:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Instance spawned successfully.
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:07 user nova-compute[75288]: INFO nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Took 7.04 seconds to spawn the instance on the hypervisor.
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:48:07 user nova-compute[75288]: INFO nova.compute.manager [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Took 7.92 seconds to build instance.
Dec 01 13:48:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d1439f50-05b3-4da1-8f15-bd53e5add9ba tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.034s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:48:08 user nova-compute[75288]: INFO nova.compute.claims [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Claim successful on node user
Dec 01 13:48:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:48:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-f7c4b774-4c57-4ef0-b0c0-b271a32a8715 req-01c82be2-5b59-4d37-8af2-75d63a694c09 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received event network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7c4b774-4c57-4ef0-b0c0-b271a32a8715 req-01c82be2-5b59-4d37-8af2-75d63a694c09 service nova] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7c4b774-4c57-4ef0-b0c0-b271a32a8715 req-01c82be2-5b59-4d37-8af2-75d63a694c09 service nova] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f7c4b774-4c57-4ef0-b0c0-b271a32a8715 req-01c82be2-5b59-4d37-8af2-75d63a694c09 service nova] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-f7c4b774-4c57-4ef0-b0c0-b271a32a8715 req-01c82be2-5b59-4d37-8af2-75d63a694c09 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] No waiting events found dispatching network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:08 user nova-compute[75288]: WARNING nova.compute.manager [req-f7c4b774-4c57-4ef0-b0c0-b271a32a8715 req-01c82be2-5b59-4d37-8af2-75d63a694c09 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received unexpected event network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 for instance with vm_state active and task_state None.
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.policy [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed40cc9c841944479fe35d4b1f564506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ccafe7cd43a4946bf78cc6ed7f8e889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:48:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Creating image(s)
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "/opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "/opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "/opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk 1073741824" returned: 0 in 0.064s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Cannot resize image /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Ensure instance console log exists: /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Successfully created port: f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Successfully updated port: f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquired lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-7efee735-764e-476e-a288-54556ce7932a req-f33ad539-5c3a-4317-9446-a82183e5ec4e service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received event network-changed-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-7efee735-764e-476e-a288-54556ce7932a req-f33ad539-5c3a-4317-9446-a82183e5ec4e service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Refreshing instance network info cache due to event network-changed-f515fe97-64dc-4a0c-89e7-0378f1d90379. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7efee735-764e-476e-a288-54556ce7932a req-f33ad539-5c3a-4317-9446-a82183e5ec4e service nova] Acquiring lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG nova.network.neutron [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-650be7ac-f364-4131-9b59-b1d9b3a64f78 req-521947a9-d3c3-4cfb-8876-ca0de81272cb service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received event network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-650be7ac-f364-4131-9b59-b1d9b3a64f78 req-521947a9-d3c3-4cfb-8876-ca0de81272cb service nova] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-650be7ac-f364-4131-9b59-b1d9b3a64f78 req-521947a9-d3c3-4cfb-8876-ca0de81272cb service nova] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-650be7ac-f364-4131-9b59-b1d9b3a64f78 req-521947a9-d3c3-4cfb-8876-ca0de81272cb service nova] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-650be7ac-f364-4131-9b59-b1d9b3a64f78 req-521947a9-d3c3-4cfb-8876-ca0de81272cb service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] No waiting events found dispatching network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:10 user nova-compute[75288]: WARNING nova.compute.manager [req-650be7ac-f364-4131-9b59-b1d9b3a64f78 req-521947a9-d3c3-4cfb-8876-ca0de81272cb service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received unexpected event network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 for instance with vm_state active and task_state None.
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Updating instance_info_cache with network_info: [{"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Releasing lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Instance network_info: |[{"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7efee735-764e-476e-a288-54556ce7932a req-f33ad539-5c3a-4317-9446-a82183e5ec4e service nova] Acquired lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-7efee735-764e-476e-a288-54556ce7932a req-f33ad539-5c3a-4317-9446-a82183e5ec4e service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Refreshing network info cache for port f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Start _get_guest_xml network_info=[{"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:48:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:11 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1203900004',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1203900004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1203900',id=18,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9GOodf5mR9oTrjcjLJOV/QADGlL2Cbk3WhS6rmusV4eTmWVYzoixK6ulVZ0RHn9pMNdhycljMxlw4ONf5IPnu2PPAIL565EZgzJ8M89yWcq5lzDyzGRPDti7ve/LWC9w==',key_name='tempest-keypair-474320352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ccafe7cd43a4946bf78cc6ed7f8e889',ramdisk_id='',reservation_id='r-1wojr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-789868515',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed40cc9c841944479fe35d4b1f564506',uuid=d000b879-6b79-4f80-a69d-548d8108c1ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Converting VIF {"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:93:91,bridge_name='br-int',has_traffic_filtering=True,id=f515fe97-64dc-4a0c-89e7-0378f1d90379,network=Network(1861dc26-c3f9-411c-b1ce-89da94669940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf515fe97-64') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lazy-loading 'pci_devices' on Instance uuid d000b879-6b79-4f80-a69d-548d8108c1ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:48:11 user nova-compute[75288]:   <uuid>d000b879-6b79-4f80-a69d-548d8108c1ae</uuid>
Dec 01 13:48:11 user nova-compute[75288]:   <name>instance-00000012</name>
Dec 01 13:48:11 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:48:11 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:48:11 user nova-compute[75288]:   <metadata>
Dec 01 13:48:11 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:48:11 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:48:11 user nova-compute[75288]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1203900004</nova:name>
Dec 01 13:48:11 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:48:11</nova:creationTime>
Dec 01 13:48:11 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:48:11 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:48:11 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:48:11 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:48:11 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:48:11 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:48:11 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:48:11 user nova-compute[75288]:       <nova:owner>
Dec 01 13:48:11 user nova-compute[75288]:         <nova:user uuid="ed40cc9c841944479fe35d4b1f564506">tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member</nova:user>
Dec 01 13:48:11 user nova-compute[75288]:         <nova:project uuid="6ccafe7cd43a4946bf78cc6ed7f8e889">tempest-TestServerVolumeAttachScenarioOldVersion-789868515</nova:project>
Dec 01 13:48:11 user nova-compute[75288]:       </nova:owner>
Dec 01 13:48:11 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:48:11 user nova-compute[75288]:       <nova:ports>
Dec 01 13:48:11 user nova-compute[75288]:         <nova:port uuid="f515fe97-64dc-4a0c-89e7-0378f1d90379">
Dec 01 13:48:11 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 13:48:11 user nova-compute[75288]:         </nova:port>
Dec 01 13:48:11 user nova-compute[75288]:       </nova:ports>
Dec 01 13:48:11 user nova-compute[75288]:     </nova:instance>
Dec 01 13:48:11 user nova-compute[75288]:   </metadata>
Dec 01 13:48:11 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:48:11 user nova-compute[75288]:     <system>
Dec 01 13:48:11 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:48:11 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:48:11 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:48:11 user nova-compute[75288]:       <entry name="serial">d000b879-6b79-4f80-a69d-548d8108c1ae</entry>
Dec 01 13:48:11 user nova-compute[75288]:       <entry name="uuid">d000b879-6b79-4f80-a69d-548d8108c1ae</entry>
Dec 01 13:48:11 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:48:11 user nova-compute[75288]:     </system>
Dec 01 13:48:11 user nova-compute[75288]:   </sysinfo>
Dec 01 13:48:11 user nova-compute[75288]:   <os>
Dec 01 13:48:11 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:48:11 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:48:11 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:48:11 user nova-compute[75288]:   </os>
Dec 01 13:48:11 user nova-compute[75288]:   <features>
Dec 01 13:48:11 user nova-compute[75288]:     <acpi/>
Dec 01 13:48:11 user nova-compute[75288]:     <apic/>
Dec 01 13:48:11 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:48:11 user nova-compute[75288]:   </features>
Dec 01 13:48:11 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:48:11 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:48:11 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:48:11 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:48:11 user nova-compute[75288]:   </clock>
Dec 01 13:48:11 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:48:11 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:48:11 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:48:11 user nova-compute[75288]:   </cpu>
Dec 01 13:48:11 user nova-compute[75288]:   <devices>
Dec 01 13:48:11 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:48:11 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:48:11 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk"/>
Dec 01 13:48:11 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:48:11 user nova-compute[75288]:     </disk>
Dec 01 13:48:11 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:48:11 user nova-compute[75288]:       <mac address="fa:16:3e:c6:93:91"/>
Dec 01 13:48:11 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:11 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:48:11 user nova-compute[75288]:       <target dev="tapf515fe97-64"/>
Dec 01 13:48:11 user nova-compute[75288]:     </interface>
Dec 01 13:48:11 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:48:11 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/console.log" append="off"/>
Dec 01 13:48:11 user nova-compute[75288]:     </serial>
Dec 01 13:48:11 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:48:11 user nova-compute[75288]:     <video>
Dec 01 13:48:11 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:11 user nova-compute[75288]:     </video>
Dec 01 13:48:11 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:48:11 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:48:11 user nova-compute[75288]:     </rng>
Dec 01 13:48:11 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:48:11 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:48:11 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:48:11 user nova-compute[75288]:     </memballoon>
Dec 01 13:48:11 user nova-compute[75288]:   </devices>
Dec 01 13:48:11 user nova-compute[75288]: </domain>
Dec 01 13:48:11 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1203900004',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1203900004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1203900',id=18,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9GOodf5mR9oTrjcjLJOV/QADGlL2Cbk3WhS6rmusV4eTmWVYzoixK6ulVZ0RHn9pMNdhycljMxlw4ONf5IPnu2PPAIL565EZgzJ8M89yWcq5lzDyzGRPDti7ve/LWC9w==',key_name='tempest-keypair-474320352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ccafe7cd43a4946bf78cc6ed7f8e889',ramdisk_id='',reservation_id='r-1wojr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-789868515',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed40cc9c841944479fe35d4b1f564506',uuid=d000b879-6b79-4f80-a69d-548d8108c1ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Converting VIF {"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:93:91,bridge_name='br-int',has_traffic_filtering=True,id=f515fe97-64dc-4a0c-89e7-0378f1d90379,network=Network(1861dc26-c3f9-411c-b1ce-89da94669940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf515fe97-64') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG os_vif [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:93:91,bridge_name='br-int',has_traffic_filtering=True,id=f515fe97-64dc-4a0c-89e7-0378f1d90379,network=Network(1861dc26-c3f9-411c-b1ce-89da94669940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf515fe97-64') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b86a44f3-d0e6-50aa-94e1-8eaf8d337458', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf515fe97-64, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf515fe97-64, col_values=(('qos', UUID('8ca717a4-5486-49f4-ae13-06cfbebd3225')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf515fe97-64, col_values=(('external_ids', {'iface-id': 'f515fe97-64dc-4a0c-89e7-0378f1d90379', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:93:91', 'vm-uuid': 'd000b879-6b79-4f80-a69d-548d8108c1ae'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:11 user nova-compute[75288]: INFO os_vif [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:93:91,bridge_name='br-int',has_traffic_filtering=True,id=f515fe97-64dc-4a0c-89e7-0378f1d90379,network=Network(1861dc26-c3f9-411c-b1ce-89da94669940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf515fe97-64')
Dec 01 13:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:48:11 user nova-compute[75288]: INFO nova.compute.claims [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Claim successful on node user
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] No VIF found with MAC fa:16:3e:c6:93:91, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-7efee735-764e-476e-a288-54556ce7932a req-f33ad539-5c3a-4317-9446-a82183e5ec4e service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Updated VIF entry in instance network info cache for port f515fe97-64dc-4a0c-89e7-0378f1d90379. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-7efee735-764e-476e-a288-54556ce7932a req-f33ad539-5c3a-4317-9446-a82183e5ec4e service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Updating instance_info_cache with network_info: [{"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7efee735-764e-476e-a288-54556ce7932a req-f33ad539-5c3a-4317-9446-a82183e5ec4e service nova] Releasing lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:48:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG nova.policy [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d66b204f52341d7bc7548ab1db31fcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '157c210a93ab4db79ea369e26c462244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:48:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Creating image(s)
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "/opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "/opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "/opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk 1073741824" returned: 0 in 0.079s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG nova.network.neutron [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Successfully created port: 33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.253s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:48:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-a6bddf47-83f5-4fe8-bdc0-551214404553 req-babc414c-87b0-4494-b154-4c833d646f2e service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received event network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6bddf47-83f5-4fe8-bdc0-551214404553 req-babc414c-87b0-4494-b154-4c833d646f2e service nova] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6bddf47-83f5-4fe8-bdc0-551214404553 req-babc414c-87b0-4494-b154-4c833d646f2e service nova] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a6bddf47-83f5-4fe8-bdc0-551214404553 req-babc414c-87b0-4494-b154-4c833d646f2e service nova] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-a6bddf47-83f5-4fe8-bdc0-551214404553 req-babc414c-87b0-4494-b154-4c833d646f2e service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] No waiting events found dispatching network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:13 user nova-compute[75288]: WARNING nova.compute.manager [req-a6bddf47-83f5-4fe8-bdc0-551214404553 req-babc414c-87b0-4494-b154-4c833d646f2e service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received unexpected event network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 for instance with vm_state building and task_state spawning.
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Cannot resize image /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Ensure instance console log exists: /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Successfully updated port: 33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "refresh_cache-2cc53f02-69ec-4302-b972-8fad7ad0e831" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquired lock "refresh_cache-2cc53f02-69ec-4302-b972-8fad7ad0e831" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-784c73b8-c33f-4b0b-bcab-7cc1614f9daf req-6fc2b0c7-2070-496c-878b-29256c5f7ede service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received event network-changed-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-784c73b8-c33f-4b0b-bcab-7cc1614f9daf req-6fc2b0c7-2070-496c-878b-29256c5f7ede service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Refreshing instance network info cache due to event network-changed-33db5216-2d25-42b7-a17b-e9e1bcd306af. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-784c73b8-c33f-4b0b-bcab-7cc1614f9daf req-6fc2b0c7-2070-496c-878b-29256c5f7ede service nova] Acquiring lock "refresh_cache-2cc53f02-69ec-4302-b972-8fad7ad0e831" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:13 user nova-compute[75288]: DEBUG nova.network.neutron [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Updating instance_info_cache with network_info: [{"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Releasing lock "refresh_cache-2cc53f02-69ec-4302-b972-8fad7ad0e831" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Instance network_info: |[{"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-784c73b8-c33f-4b0b-bcab-7cc1614f9daf req-6fc2b0c7-2070-496c-878b-29256c5f7ede service nova] Acquired lock "refresh_cache-2cc53f02-69ec-4302-b972-8fad7ad0e831" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-784c73b8-c33f-4b0b-bcab-7cc1614f9daf req-6fc2b0c7-2070-496c-878b-29256c5f7ede service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Refreshing network info cache for port 33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Start _get_guest_xml network_info=[{"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:48:14 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:14 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-515720010',display_name='tempest-DeleteServersTestJSON-server-515720010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-515720010',id=19,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='157c210a93ab4db79ea369e26c462244',ramdisk_id='',reservation_id='r-dhpy48r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-891849180',owner_user_name='tempest-DeleteServersTestJSON-891849180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:12Z,user_data=None,user_id='4d66b204f52341d7bc7548ab1db31fcc',uuid=2cc53f02-69ec-4302-b972-8fad7ad0e831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Converting VIF {"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=33db5216-2d25-42b7-a17b-e9e1bcd306af,network=Network(0ff01792-285b-45b5-994f-769dc8313257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33db5216-2d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cc53f02-69ec-4302-b972-8fad7ad0e831 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:48:14 user nova-compute[75288]:   <uuid>2cc53f02-69ec-4302-b972-8fad7ad0e831</uuid>
Dec 01 13:48:14 user nova-compute[75288]:   <name>instance-00000013</name>
Dec 01 13:48:14 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:48:14 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:48:14 user nova-compute[75288]:   <metadata>
Dec 01 13:48:14 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:48:14 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:48:14 user nova-compute[75288]:       <nova:name>tempest-DeleteServersTestJSON-server-515720010</nova:name>
Dec 01 13:48:14 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:48:14</nova:creationTime>
Dec 01 13:48:14 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:48:14 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:48:14 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:48:14 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:48:14 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:48:14 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:48:14 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:48:14 user nova-compute[75288]:       <nova:owner>
Dec 01 13:48:14 user nova-compute[75288]:         <nova:user uuid="4d66b204f52341d7bc7548ab1db31fcc">tempest-DeleteServersTestJSON-891849180-project-member</nova:user>
Dec 01 13:48:14 user nova-compute[75288]:         <nova:project uuid="157c210a93ab4db79ea369e26c462244">tempest-DeleteServersTestJSON-891849180</nova:project>
Dec 01 13:48:14 user nova-compute[75288]:       </nova:owner>
Dec 01 13:48:14 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:48:14 user nova-compute[75288]:       <nova:ports>
Dec 01 13:48:14 user nova-compute[75288]:         <nova:port uuid="33db5216-2d25-42b7-a17b-e9e1bcd306af">
Dec 01 13:48:14 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:48:14 user nova-compute[75288]:         </nova:port>
Dec 01 13:48:14 user nova-compute[75288]:       </nova:ports>
Dec 01 13:48:14 user nova-compute[75288]:     </nova:instance>
Dec 01 13:48:14 user nova-compute[75288]:   </metadata>
Dec 01 13:48:14 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:48:14 user nova-compute[75288]:     <system>
Dec 01 13:48:14 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:48:14 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:48:14 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:48:14 user nova-compute[75288]:       <entry name="serial">2cc53f02-69ec-4302-b972-8fad7ad0e831</entry>
Dec 01 13:48:14 user nova-compute[75288]:       <entry name="uuid">2cc53f02-69ec-4302-b972-8fad7ad0e831</entry>
Dec 01 13:48:14 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:48:14 user nova-compute[75288]:     </system>
Dec 01 13:48:14 user nova-compute[75288]:   </sysinfo>
Dec 01 13:48:14 user nova-compute[75288]:   <os>
Dec 01 13:48:14 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:48:14 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:48:14 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:48:14 user nova-compute[75288]:   </os>
Dec 01 13:48:14 user nova-compute[75288]:   <features>
Dec 01 13:48:14 user nova-compute[75288]:     <acpi/>
Dec 01 13:48:14 user nova-compute[75288]:     <apic/>
Dec 01 13:48:14 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:48:14 user nova-compute[75288]:   </features>
Dec 01 13:48:14 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:48:14 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:48:14 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:48:14 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:48:14 user nova-compute[75288]:   </clock>
Dec 01 13:48:14 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:48:14 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:48:14 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:48:14 user nova-compute[75288]:   </cpu>
Dec 01 13:48:14 user nova-compute[75288]:   <devices>
Dec 01 13:48:14 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:48:14 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:48:14 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk"/>
Dec 01 13:48:14 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:48:14 user nova-compute[75288]:     </disk>
Dec 01 13:48:14 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:48:14 user nova-compute[75288]:       <mac address="fa:16:3e:a4:55:22"/>
Dec 01 13:48:14 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:14 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:48:14 user nova-compute[75288]:       <target dev="tap33db5216-2d"/>
Dec 01 13:48:14 user nova-compute[75288]:     </interface>
Dec 01 13:48:14 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:48:14 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/console.log" append="off"/>
Dec 01 13:48:14 user nova-compute[75288]:     </serial>
Dec 01 13:48:14 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:48:14 user nova-compute[75288]:     <video>
Dec 01 13:48:14 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:14 user nova-compute[75288]:     </video>
Dec 01 13:48:14 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:48:14 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:48:14 user nova-compute[75288]:     </rng>
Dec 01 13:48:14 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:48:14 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:48:14 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:48:14 user nova-compute[75288]:     </memballoon>
Dec 01 13:48:14 user nova-compute[75288]:   </devices>
Dec 01 13:48:14 user nova-compute[75288]: </domain>
Dec 01 13:48:14 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-515720010',display_name='tempest-DeleteServersTestJSON-server-515720010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-515720010',id=19,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='157c210a93ab4db79ea369e26c462244',ramdisk_id='',reservation_id='r-dhpy48r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-891849180',owner_user_name='tempest-DeleteServersTestJSON-891849180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:12Z,user_data=None,user_id='4d66b204f52341d7bc7548ab1db31fcc',uuid=2cc53f02-69ec-4302-b972-8fad7ad0e831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Converting VIF {"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=33db5216-2d25-42b7-a17b-e9e1bcd306af,network=Network(0ff01792-285b-45b5-994f-769dc8313257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33db5216-2d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG os_vif [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=33db5216-2d25-42b7-a17b-e9e1bcd306af,network=Network(0ff01792-285b-45b5-994f-769dc8313257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33db5216-2d') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a0a3a3f-de65-57f2-b6cf-6b21801be771', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33db5216-2d, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33db5216-2d, col_values=(('qos', UUID('a715e653-fdc3-412b-a07d-c5e971dac426')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33db5216-2d, col_values=(('external_ids', {'iface-id': '33db5216-2d25-42b7-a17b-e9e1bcd306af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:55:22', 'vm-uuid': '2cc53f02-69ec-4302-b972-8fad7ad0e831'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:14 user nova-compute[75288]: INFO os_vif [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=33db5216-2d25-42b7-a17b-e9e1bcd306af,network=Network(0ff01792-285b-45b5-994f-769dc8313257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33db5216-2d')
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] No VIF found with MAC fa:16:3e:a4:55:22, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-784c73b8-c33f-4b0b-bcab-7cc1614f9daf req-6fc2b0c7-2070-496c-878b-29256c5f7ede service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Updated VIF entry in instance network info cache for port 33db5216-2d25-42b7-a17b-e9e1bcd306af. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-784c73b8-c33f-4b0b-bcab-7cc1614f9daf req-6fc2b0c7-2070-496c-878b-29256c5f7ede service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Updating instance_info_cache with network_info: [{"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-784c73b8-c33f-4b0b-bcab-7cc1614f9daf req-6fc2b0c7-2070-496c-878b-29256c5f7ede service nova] Releasing lock "refresh_cache-2cc53f02-69ec-4302-b972-8fad7ad0e831" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:48:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Instance spawned successfully.
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-fbccfd8b-00cd-49f4-acdb-10cbe2772025 req-b71fdff6-3ce6-4302-8c9a-01dd2a491a70 service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received event network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbccfd8b-00cd-49f4-acdb-10cbe2772025 req-b71fdff6-3ce6-4302-8c9a-01dd2a491a70 service nova] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbccfd8b-00cd-49f4-acdb-10cbe2772025 req-b71fdff6-3ce6-4302-8c9a-01dd2a491a70 service nova] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fbccfd8b-00cd-49f4-acdb-10cbe2772025 req-b71fdff6-3ce6-4302-8c9a-01dd2a491a70 service nova] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-fbccfd8b-00cd-49f4-acdb-10cbe2772025 req-b71fdff6-3ce6-4302-8c9a-01dd2a491a70 service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] No waiting events found dispatching network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:15 user nova-compute[75288]: WARNING nova.compute.manager [req-fbccfd8b-00cd-49f4-acdb-10cbe2772025 req-b71fdff6-3ce6-4302-8c9a-01dd2a491a70 service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received unexpected event network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 for instance with vm_state building and task_state spawning.
Dec 01 13:48:15 user nova-compute[75288]: INFO nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Took 6.41 seconds to spawn the instance on the hypervisor.
Dec 01 13:48:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:48:15 user nova-compute[75288]: INFO nova.compute.manager [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Took 7.43 seconds to build instance.
Dec 01 13:48:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-585c5fc9-2316-4e0c-a8ce-6f9db3936fc5 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.544s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received event network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] No waiting events found dispatching network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:17 user nova-compute[75288]: WARNING nova.compute.manager [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received unexpected event network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af for instance with vm_state building and task_state spawning.
Dec 01 13:48:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received event network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] No waiting events found dispatching network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:17 user nova-compute[75288]: WARNING nova.compute.manager [req-730ee909-ea64-45e3-ae12-37913e262363 req-aa35faf4-30a0-4cde-aebf-19220577284d service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received unexpected event network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af for instance with vm_state building and task_state spawning.
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:48:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Instance spawned successfully.
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:48:18 user nova-compute[75288]: INFO nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Took 6.08 seconds to spawn the instance on the hypervisor.
Dec 01 13:48:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:48:18 user nova-compute[75288]: INFO nova.compute.manager [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Took 7.01 seconds to build instance.
Dec 01 13:48:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-14b0a11a-b228-4aa9-9b48-0385259ca4ac tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.138s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating instance_info_cache with network_info: [{"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-2c66ff7f-d0d9-43ff-98a4-bb702780e080" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7392MB free_disk=25.330345153808594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Applying migration context for instance 2c66ff7f-d0d9-43ff-98a4-bb702780e080 as it has an incoming, in-progress migration 026c43db-a46f-495d-a500-7e7de874989c. Migration status is error {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=75288) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0ab72540-6333-4a3b-bb5f-411e607bac1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2aba04bd-402b-4a52-8394-3a59339a8f9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 64e25352-1ed2-4eda-a376-cb722f0b779f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2c66ff7f-d0d9-43ff-98a4-bb702780e080 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d000b879-6b79-4f80-a69d-548d8108c1ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2cc53f02-69ec-4302-b972-8fad7ad0e831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:48:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:48:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:34 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:48:34 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:48:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:48:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.703s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "3448c364-2dab-4110-a59f-cc973f73845c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "3448c364-2dab-4110-a59f-cc973f73845c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:48:43 user nova-compute[75288]: INFO nova.compute.claims [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Claim successful on node user
Dec 01 13:48:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:48:43 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:48:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:48:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:48:43 user nova-compute[75288]: INFO nova.virt.block_device [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Booting with volume bb587a52-3fa5-460e-bb89-6e50e873f6e4 at /dev/vda
Dec 01 13:48:44 user nova-compute[75288]: DEBUG os_brick.utils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac7d408-60af-4b1a-94d8-0acef63e28ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG nova.policy [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab6a9e09550e42edac3c1e8a9112fbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1120cc4cc3d8458aaf5755a500e994c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[509a9279-1ac0-46b2-9907-0c96db222296]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[982fea94-d947-4877-8f85-d39c2d3a4c77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc45a62d-f014-40ba-bacb-9dad7c4834e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:48:44 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:48:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0728163-93c3-459d-b2ea-dab2c4264ec8]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG os_brick.utils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Updating existing volume attachment record: a731bf8a-78a3-42d1-9832-cbfe46531652 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:48:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Successfully created port: 83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:48:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Successfully updated port: 83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:48:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquired lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:48:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:48:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-4cc166c5-1cf0-4f49-ad15-7a2c1a42bc48 req-d53a2fa4-4f5a-45f1-ab3b-c3c4fa80fb18 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received event network-changed-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-4cc166c5-1cf0-4f49-ad15-7a2c1a42bc48 req-d53a2fa4-4f5a-45f1-ab3b-c3c4fa80fb18 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Refreshing instance network info cache due to event network-changed-83cab345-de3c-455d-9b6a-9708a59fc91e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:48:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4cc166c5-1cf0-4f49-ad15-7a2c1a42bc48 req-d53a2fa4-4f5a-45f1-ab3b-c3c4fa80fb18 service nova] Acquiring lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Updating instance_info_cache with network_info: [{"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Releasing lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Instance network_info: |[{"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:48:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4cc166c5-1cf0-4f49-ad15-7a2c1a42bc48 req-d53a2fa4-4f5a-45f1-ab3b-c3c4fa80fb18 service nova] Acquired lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-4cc166c5-1cf0-4f49-ad15-7a2c1a42bc48 req-d53a2fa4-4f5a-45f1-ab3b-c3c4fa80fb18 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Refreshing network info cache for port 83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:48:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-4cc166c5-1cf0-4f49-ad15-7a2c1a42bc48 req-d53a2fa4-4f5a-45f1-ab3b-c3c4fa80fb18 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Updated VIF entry in instance network info cache for port 83cab345-de3c-455d-9b6a-9708a59fc91e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:48:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-4cc166c5-1cf0-4f49-ad15-7a2c1a42bc48 req-d53a2fa4-4f5a-45f1-ab3b-c3c4fa80fb18 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Updating instance_info_cache with network_info: [{"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4cc166c5-1cf0-4f49-ad15-7a2c1a42bc48 req-d53a2fa4-4f5a-45f1-ab3b-c3c4fa80fb18 service nova] Releasing lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-39f0b1c3-94a1-4ed2-b5a6-b87269076791 req-45552933-e0d8-4176-a139-90e43d5bc929 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-changed-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-39f0b1c3-94a1-4ed2-b5a6-b87269076791 req-45552933-e0d8-4176-a139-90e43d5bc929 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Refreshing instance network info cache due to event network-changed-333c0000-ff58-4863-9d8e-0ddb10c68fd4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:48:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39f0b1c3-94a1-4ed2-b5a6-b87269076791 req-45552933-e0d8-4176-a139-90e43d5bc929 service nova] Acquiring lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39f0b1c3-94a1-4ed2-b5a6-b87269076791 req-45552933-e0d8-4176-a139-90e43d5bc929 service nova] Acquired lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-39f0b1c3-94a1-4ed2-b5a6-b87269076791 req-45552933-e0d8-4176-a139-90e43d5bc929 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Refreshing network info cache for port 333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'flavor' on Instance uuid 64e25352-1ed2-4eda-a376-cb722f0b779f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:49 user nova-compute[75288]: INFO nova.compute.manager [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Attaching volume 0b2d4a57-112e-44c5-96bf-a5117bed88f5 to /dev/vdb
Dec 01 13:48:49 user nova-compute[75288]: DEBUG os_brick.utils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eab8f78-4d2b-437d-9aa1-35f79e7630ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "2aba04bd-402b-4a52-8394-3a59339a8f9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a4e1a8-3d03-4503-94d3-cb0cc1e1a39d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:49 user nova-compute[75288]: INFO nova.compute.manager [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Terminating instance
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea3befa-0717-4b0c-998b-c3bdd12ee14b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f328f70e-6b94-4423-9f52-b664e7da1607]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:48:49 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:48:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[76434200-9bd4-4680-87e5-9bfed9f7c743]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG os_brick.utils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updating existing volume attachment record: 24d4c4d4-a5fa-4abe-9aad-18e98f18c257 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-39f0b1c3-94a1-4ed2-b5a6-b87269076791 req-45552933-e0d8-4176-a139-90e43d5bc929 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updated VIF entry in instance network info cache for port 333c0000-ff58-4863-9d8e-0ddb10c68fd4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:48:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-39f0b1c3-94a1-4ed2-b5a6-b87269076791 req-45552933-e0d8-4176-a139-90e43d5bc929 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updating instance_info_cache with network_info: [{"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-39f0b1c3-94a1-4ed2-b5a6-b87269076791 req-45552933-e0d8-4176-a139-90e43d5bc929 service nova] Releasing lock "refresh_cache-64e25352-1ed2-4eda-a376-cb722f0b779f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Instance destroyed successfully.
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lazy-loading 'resources' on Instance uuid 2aba04bd-402b-4a52-8394-3a59339a8f9b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-341024266',display_name='tempest-VolumesAdminNegativeTest-server-341024266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-341024266',id=14,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d820dd1ad9d42229c9537044fd32cbb',ramdisk_id='',reservation_id='r-jw2btvge',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1728786286',owner_user_name='tempest-VolumesAdminNegativeTest-1728786286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:46:58Z,user_data=None,user_id='b14b041e05644358b3365ca675a93cfe',uuid=2aba04bd-402b-4a52-8394-3a59339a8f9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converting VIF {"id": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "address": "fa:16:3e:9b:19:59", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd573751-6b", "ovs_interfaceid": "bd573751-6be1-4d1a-a4df-ce6d8ceb6edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:59,bridge_name='br-int',has_traffic_filtering=True,id=bd573751-6be1-4d1a-a4df-ce6d8ceb6edc,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd573751-6b') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG os_vif [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:59,bridge_name='br-int',has_traffic_filtering=True,id=bd573751-6be1-4d1a-a4df-ce6d8ceb6edc,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd573751-6b') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd573751-6b, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60e7784b-c7a0-4535-a972-2efbfc6e1f67) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:50 user nova-compute[75288]: INFO os_vif [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:59,bridge_name='br-int',has_traffic_filtering=True,id=bd573751-6be1-4d1a-a4df-ce6d8ceb6edc,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd573751-6b')
Dec 01 13:48:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Deleting instance files /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b_del
Dec 01 13:48:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Deletion of /opt/stack/data/nova/instances/2aba04bd-402b-4a52-8394-3a59339a8f9b_del complete
Dec 01 13:48:50 user nova-compute[75288]: INFO nova.compute.manager [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Took 1.06 seconds to destroy the instance on the hypervisor.
Dec 01 13:48:50 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-65743acb-198a-42e4-b76b-e5517849e29a req-d29e676e-7489-4444-8ae4-2ba95ae5afb2 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received event network-vif-unplugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-65743acb-198a-42e4-b76b-e5517849e29a req-d29e676e-7489-4444-8ae4-2ba95ae5afb2 service nova] Acquiring lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-65743acb-198a-42e4-b76b-e5517849e29a req-d29e676e-7489-4444-8ae4-2ba95ae5afb2 service nova] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-65743acb-198a-42e4-b76b-e5517849e29a req-d29e676e-7489-4444-8ae4-2ba95ae5afb2 service nova] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-65743acb-198a-42e4-b76b-e5517849e29a req-d29e676e-7489-4444-8ae4-2ba95ae5afb2 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] No waiting events found dispatching network-vif-unplugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-65743acb-198a-42e4-b76b-e5517849e29a req-d29e676e-7489-4444-8ae4-2ba95ae5afb2 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received event network-vif-unplugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:48:51 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:51 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Took 0.73 seconds to deallocate network for instance.
Dec 01 13:48:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-37a06168-e5ab-46e4-b712-bdf2adf32158 req-f9b9fe07-e29f-49f6-a2dd-caa4e8801619 service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received event network-vif-deleted-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:51 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:48:51 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:48:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:52 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Deleted allocations for instance 2aba04bd-402b-4a52-8394-3a59339a8f9b
Dec 01 13:48:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c6fe7e9e-3aed-4e83-b61b-fa0eb29dfb23 tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.451s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-bfe50c0b-9ce1-44d2-8fa3-0d383d46f41b req-4288e5c7-9412-4e9c-8f38-8a55cfabfa9f service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received event network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bfe50c0b-9ce1-44d2-8fa3-0d383d46f41b req-4288e5c7-9412-4e9c-8f38-8a55cfabfa9f service nova] Acquiring lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bfe50c0b-9ce1-44d2-8fa3-0d383d46f41b req-4288e5c7-9412-4e9c-8f38-8a55cfabfa9f service nova] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bfe50c0b-9ce1-44d2-8fa3-0d383d46f41b req-4288e5c7-9412-4e9c-8f38-8a55cfabfa9f service nova] Lock "2aba04bd-402b-4a52-8394-3a59339a8f9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-bfe50c0b-9ce1-44d2-8fa3-0d383d46f41b req-4288e5c7-9412-4e9c-8f38-8a55cfabfa9f service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] No waiting events found dispatching network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:52 user nova-compute[75288]: WARNING nova.compute.manager [req-bfe50c0b-9ce1-44d2-8fa3-0d383d46f41b req-4288e5c7-9412-4e9c-8f38-8a55cfabfa9f service nova] [instance: 2aba04bd-402b-4a52-8394-3a59339a8f9b] Received unexpected event network-vif-plugged-bd573751-6be1-4d1a-a4df-ce6d8ceb6edc for instance with vm_state deleted and task_state None.
Dec 01 13:48:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:48:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:48:54 user nova-compute[75288]: INFO nova.compute.claims [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Claim successful on node user
Dec 01 13:48:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:48:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:48:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Creating image(s)
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Ensure instance console log exists: /opt/stack/data/nova/instances/3448c364-2dab-4110-a59f-cc973f73845c/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Start _get_guest_xml network_info=[{"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a731bf8a-78a3-42d1-9832-cbfe46531652', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KraZUmid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3448c364-2dab-4110-a59f-cc973f73845c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'serial': 'bb587a52-3fa5-460e-bb89-6e50e873f6e4'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:48:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KraZUmid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:48:55 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:48:55 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:48:55 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.policy [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3da01fd9ed04c2984868b13e38d3983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7111fdc7a44f539b3c53ac5c7b4961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:48:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Creating image(s)
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef30be5-9e80-4c38-ab2d-d074731ed6d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:48:55 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6d090-bafa-4c23-900c-a2a7a45dcf0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4] added
Dec 01 13:48:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5cbec3-f619-4f3f-b410-cd773362800d]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4434ec8b-4ec1-481f-a5ec-3b9db2e850cb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KraZUmid {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KraZUmid" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d79080-77d0-4e6d-b41a-f294addb297e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KraZUmid'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27a73c3-1810-4c3a-b8a3-f7ffa8cabb6e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6579cdbe-e738-4c3f-837a-907d014cda2d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:48:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:48:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7ff7c-66f7-4c8f-859c-eb1cf177b5c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260]
Dec 01 13:48:55 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260] successful.
Dec 01 13:48:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[741223d2-d4d9-4a31-a95d-867425556799]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6767160f-3b67-4e8e-b1d5-5e142ebc642b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:48:55 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:48:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:48:55 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:48:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[638fb43d-e04d-4017-b51c-40030bd31e3c]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KraZUmid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.222s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk 1073741824" returned: 0 in 0.053s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Successfully created port: 149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Cannot resize image /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Ensure instance console log exists: /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23563383564383065', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563383564383065', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-558391406',display_name='tempest-TestVolumeBootPattern-server-558391406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-558391406',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-g663vi2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:44Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=3448c364-2dab-4110-a59f-cc973f73845c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:8b:24,bridge_name='br-int',has_traffic_filtering=True,id=83cab345-de3c-455d-9b6a-9708a59fc91e,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cab345-de') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lazy-loading 'pci_devices' on Instance uuid 3448c364-2dab-4110-a59f-cc973f73845c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:48:56 user nova-compute[75288]:   <uuid>3448c364-2dab-4110-a59f-cc973f73845c</uuid>
Dec 01 13:48:56 user nova-compute[75288]:   <name>instance-00000014</name>
Dec 01 13:48:56 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:48:56 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:48:56 user nova-compute[75288]:   <metadata>
Dec 01 13:48:56 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:48:56 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:48:56 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-server-558391406</nova:name>
Dec 01 13:48:56 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:48:55</nova:creationTime>
Dec 01 13:48:56 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:48:56 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:48:56 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:48:56 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:48:56 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:48:56 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:48:56 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:48:56 user nova-compute[75288]:       <nova:owner>
Dec 01 13:48:56 user nova-compute[75288]:         <nova:user uuid="ab6a9e09550e42edac3c1e8a9112fbd1">tempest-TestVolumeBootPattern-367476607-project-member</nova:user>
Dec 01 13:48:56 user nova-compute[75288]:         <nova:project uuid="1120cc4cc3d8458aaf5755a500e994c6">tempest-TestVolumeBootPattern-367476607</nova:project>
Dec 01 13:48:56 user nova-compute[75288]:       </nova:owner>
Dec 01 13:48:56 user nova-compute[75288]:       <nova:ports>
Dec 01 13:48:56 user nova-compute[75288]:         <nova:port uuid="83cab345-de3c-455d-9b6a-9708a59fc91e">
Dec 01 13:48:56 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 13:48:56 user nova-compute[75288]:         </nova:port>
Dec 01 13:48:56 user nova-compute[75288]:       </nova:ports>
Dec 01 13:48:56 user nova-compute[75288]:     </nova:instance>
Dec 01 13:48:56 user nova-compute[75288]:   </metadata>
Dec 01 13:48:56 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:48:56 user nova-compute[75288]:     <system>
Dec 01 13:48:56 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:48:56 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:48:56 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:48:56 user nova-compute[75288]:       <entry name="serial">3448c364-2dab-4110-a59f-cc973f73845c</entry>
Dec 01 13:48:56 user nova-compute[75288]:       <entry name="uuid">3448c364-2dab-4110-a59f-cc973f73845c</entry>
Dec 01 13:48:56 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:48:56 user nova-compute[75288]:     </system>
Dec 01 13:48:56 user nova-compute[75288]:   </sysinfo>
Dec 01 13:48:56 user nova-compute[75288]:   <os>
Dec 01 13:48:56 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:48:56 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:48:56 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:48:56 user nova-compute[75288]:   </os>
Dec 01 13:48:56 user nova-compute[75288]:   <features>
Dec 01 13:48:56 user nova-compute[75288]:     <acpi/>
Dec 01 13:48:56 user nova-compute[75288]:     <apic/>
Dec 01 13:48:56 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:48:56 user nova-compute[75288]:   </features>
Dec 01 13:48:56 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:48:56 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:48:56 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:48:56 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:48:56 user nova-compute[75288]:   </clock>
Dec 01 13:48:56 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:48:56 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:48:56 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:48:56 user nova-compute[75288]:   </cpu>
Dec 01 13:48:56 user nova-compute[75288]:   <devices>
Dec 01 13:48:56 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:48:56 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:48:56 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Dec 01 13:48:56 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:48:56 user nova-compute[75288]:       <serial>bb587a52-3fa5-460e-bb89-6e50e873f6e4</serial>
Dec 01 13:48:56 user nova-compute[75288]:     </disk>
Dec 01 13:48:56 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:48:56 user nova-compute[75288]:       <mac address="fa:16:3e:55:8b:24"/>
Dec 01 13:48:56 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:56 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:48:56 user nova-compute[75288]:       <target dev="tap83cab345-de"/>
Dec 01 13:48:56 user nova-compute[75288]:     </interface>
Dec 01 13:48:56 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:48:56 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/3448c364-2dab-4110-a59f-cc973f73845c/console.log" append="off"/>
Dec 01 13:48:56 user nova-compute[75288]:     </serial>
Dec 01 13:48:56 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:48:56 user nova-compute[75288]:     <video>
Dec 01 13:48:56 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:56 user nova-compute[75288]:     </video>
Dec 01 13:48:56 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:48:56 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:48:56 user nova-compute[75288]:     </rng>
Dec 01 13:48:56 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:48:56 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:48:56 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:48:56 user nova-compute[75288]:     </memballoon>
Dec 01 13:48:56 user nova-compute[75288]:   </devices>
Dec 01 13:48:56 user nova-compute[75288]: </domain>
Dec 01 13:48:56 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-558391406',display_name='tempest-TestVolumeBootPattern-server-558391406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-558391406',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-g663vi2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:44Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=3448c364-2dab-4110-a59f-cc973f73845c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:8b:24,bridge_name='br-int',has_traffic_filtering=True,id=83cab345-de3c-455d-9b6a-9708a59fc91e,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cab345-de') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG os_vif [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:8b:24,bridge_name='br-int',has_traffic_filtering=True,id=83cab345-de3c-455d-9b6a-9708a59fc91e,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cab345-de') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c800f20-6873-536f-9297-84b2c2279f68', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83cab345-de, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83cab345-de, col_values=(('qos', UUID('2821f46a-4dd1-45e1-a8ea-ccd4e500e5b7')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83cab345-de, col_values=(('external_ids', {'iface-id': '83cab345-de3c-455d-9b6a-9708a59fc91e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:8b:24', 'vm-uuid': '3448c364-2dab-4110-a59f-cc973f73845c'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:56 user nova-compute[75288]: INFO os_vif [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:8b:24,bridge_name='br-int',has_traffic_filtering=True,id=83cab345-de3c-455d-9b6a-9708a59fc91e,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cab345-de')
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] No VIF found with MAC fa:16:3e:55:8b:24, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Successfully updated port: 149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquired lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-e1f5a9b2-ed42-4957-b2d4-0bb06cf3a5d7 req-2cb71ce8-d0b0-44a2-aa0d-51f5108ab9c3 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-changed-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-e1f5a9b2-ed42-4957-b2d4-0bb06cf3a5d7 req-2cb71ce8-d0b0-44a2-aa0d-51f5108ab9c3 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Refreshing instance network info cache due to event network-changed-149cf680-382c-459a-873b-fb777184f080. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e1f5a9b2-ed42-4957-b2d4-0bb06cf3a5d7 req-2cb71ce8-d0b0-44a2-aa0d-51f5108ab9c3 service nova] Acquiring lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:48:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Releasing lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Instance network_info: |[{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e1f5a9b2-ed42-4957-b2d4-0bb06cf3a5d7 req-2cb71ce8-d0b0-44a2-aa0d-51f5108ab9c3 service nova] Acquired lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-e1f5a9b2-ed42-4957-b2d4-0bb06cf3a5d7 req-2cb71ce8-d0b0-44a2-aa0d-51f5108ab9c3 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Refreshing network info cache for port 149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Start _get_guest_xml network_info=[{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:48:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converting VIF {"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:77:ab,bridge_name='br-int',has_traffic_filtering=True,id=149cf680-382c-459a-873b-fb777184f080,network=Network(dcc40867-00ab-464e-86ef-2d0a99594cc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149cf680-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lazy-loading 'pci_devices' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:48:57 user nova-compute[75288]:   <uuid>b6118993-49ad-4e01-8b70-e79eaf510b59</uuid>
Dec 01 13:48:57 user nova-compute[75288]:   <name>instance-00000015</name>
Dec 01 13:48:57 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:48:57 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:48:57 user nova-compute[75288]:   <metadata>
Dec 01 13:48:57 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:48:57 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:48:57 user nova-compute[75288]:       <nova:name>tempest-device-tagging-server-1037148651</nova:name>
Dec 01 13:48:57 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:48:57</nova:creationTime>
Dec 01 13:48:57 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:48:57 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:48:57 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:48:57 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:48:57 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:48:57 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:48:57 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:48:57 user nova-compute[75288]:       <nova:owner>
Dec 01 13:48:57 user nova-compute[75288]:         <nova:user uuid="d3da01fd9ed04c2984868b13e38d3983">tempest-TaggedAttachmentsTest-799909704-project-member</nova:user>
Dec 01 13:48:57 user nova-compute[75288]:         <nova:project uuid="8f7111fdc7a44f539b3c53ac5c7b4961">tempest-TaggedAttachmentsTest-799909704</nova:project>
Dec 01 13:48:57 user nova-compute[75288]:       </nova:owner>
Dec 01 13:48:57 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:48:57 user nova-compute[75288]:       <nova:ports>
Dec 01 13:48:57 user nova-compute[75288]:         <nova:port uuid="149cf680-382c-459a-873b-fb777184f080">
Dec 01 13:48:57 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:48:57 user nova-compute[75288]:         </nova:port>
Dec 01 13:48:57 user nova-compute[75288]:       </nova:ports>
Dec 01 13:48:57 user nova-compute[75288]:     </nova:instance>
Dec 01 13:48:57 user nova-compute[75288]:   </metadata>
Dec 01 13:48:57 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:48:57 user nova-compute[75288]:     <system>
Dec 01 13:48:57 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:48:57 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:48:57 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:48:57 user nova-compute[75288]:       <entry name="serial">b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:48:57 user nova-compute[75288]:       <entry name="uuid">b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:48:57 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:48:57 user nova-compute[75288]:     </system>
Dec 01 13:48:57 user nova-compute[75288]:   </sysinfo>
Dec 01 13:48:57 user nova-compute[75288]:   <os>
Dec 01 13:48:57 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:48:57 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:48:57 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:48:57 user nova-compute[75288]:   </os>
Dec 01 13:48:57 user nova-compute[75288]:   <features>
Dec 01 13:48:57 user nova-compute[75288]:     <acpi/>
Dec 01 13:48:57 user nova-compute[75288]:     <apic/>
Dec 01 13:48:57 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:48:57 user nova-compute[75288]:   </features>
Dec 01 13:48:57 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:48:57 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:48:57 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:48:57 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:48:57 user nova-compute[75288]:   </clock>
Dec 01 13:48:57 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:48:57 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:48:57 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:48:57 user nova-compute[75288]:   </cpu>
Dec 01 13:48:57 user nova-compute[75288]:   <devices>
Dec 01 13:48:57 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:48:57 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:48:57 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk"/>
Dec 01 13:48:57 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:48:57 user nova-compute[75288]:     </disk>
Dec 01 13:48:57 user nova-compute[75288]:     <disk type="file" device="cdrom">
Dec 01 13:48:57 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 13:48:57 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.config"/>
Dec 01 13:48:57 user nova-compute[75288]:       <target dev="hda" bus="ide"/>
Dec 01 13:48:57 user nova-compute[75288]:     </disk>
Dec 01 13:48:57 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:48:57 user nova-compute[75288]:       <mac address="fa:16:3e:b5:77:ab"/>
Dec 01 13:48:57 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:57 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:48:57 user nova-compute[75288]:       <target dev="tap149cf680-38"/>
Dec 01 13:48:57 user nova-compute[75288]:     </interface>
Dec 01 13:48:57 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:48:57 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log" append="off"/>
Dec 01 13:48:57 user nova-compute[75288]:     </serial>
Dec 01 13:48:57 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:48:57 user nova-compute[75288]:     <video>
Dec 01 13:48:57 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:48:57 user nova-compute[75288]:     </video>
Dec 01 13:48:57 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:48:57 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:48:57 user nova-compute[75288]:     </rng>
Dec 01 13:48:57 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:48:57 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:48:57 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:48:57 user nova-compute[75288]:     </memballoon>
Dec 01 13:48:57 user nova-compute[75288]:   </devices>
Dec 01 13:48:57 user nova-compute[75288]: </domain>
Dec 01 13:48:57 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converting VIF {"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:77:ab,bridge_name='br-int',has_traffic_filtering=True,id=149cf680-382c-459a-873b-fb777184f080,network=Network(dcc40867-00ab-464e-86ef-2d0a99594cc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149cf680-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG os_vif [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:77:ab,bridge_name='br-int',has_traffic_filtering=True,id=149cf680-382c-459a-873b-fb777184f080,network=Network(dcc40867-00ab-464e-86ef-2d0a99594cc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149cf680-38') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8784db14-5ac7-54c7-baec-460c38f70600', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap149cf680-38, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap149cf680-38, col_values=(('qos', UUID('92a80fc5-c93c-4c25-8132-9fe4932c84ad')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap149cf680-38, col_values=(('external_ids', {'iface-id': '149cf680-382c-459a-873b-fb777184f080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:77:ab', 'vm-uuid': 'b6118993-49ad-4e01-8b70-e79eaf510b59'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:57 user nova-compute[75288]: INFO os_vif [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:77:ab,bridge_name='br-int',has_traffic_filtering=True,id=149cf680-382c-459a-873b-fb777184f080,network=Network(dcc40867-00ab-464e-86ef-2d0a99594cc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149cf680-38')
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:48:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No VIF found with MAC fa:16:3e:b5:77:ab, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:48:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Using config drive
Dec 01 13:48:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Creating config drive at /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.config
Dec 01 13:48:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt1axtt2f {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt1axtt2f" returned: 0 in 0.073s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-770efc9d-f498-4618-9e38-b497bdce2550 req-d09607d3-1184-4bbc-8044-9c28beba927b service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received event network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-770efc9d-f498-4618-9e38-b497bdce2550 req-d09607d3-1184-4bbc-8044-9c28beba927b service nova] Acquiring lock "3448c364-2dab-4110-a59f-cc973f73845c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-770efc9d-f498-4618-9e38-b497bdce2550 req-d09607d3-1184-4bbc-8044-9c28beba927b service nova] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-770efc9d-f498-4618-9e38-b497bdce2550 req-d09607d3-1184-4bbc-8044-9c28beba927b service nova] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-770efc9d-f498-4618-9e38-b497bdce2550 req-d09607d3-1184-4bbc-8044-9c28beba927b service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] No waiting events found dispatching network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:48:58 user nova-compute[75288]: WARNING nova.compute.manager [req-770efc9d-f498-4618-9e38-b497bdce2550 req-d09607d3-1184-4bbc-8044-9c28beba927b service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received unexpected event network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e for instance with vm_state building and task_state spawning.
Dec 01 13:48:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-e1f5a9b2-ed42-4957-b2d4-0bb06cf3a5d7 req-2cb71ce8-d0b0-44a2-aa0d-51f5108ab9c3 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updated VIF entry in instance network info cache for port 149cf680-382c-459a-873b-fb777184f080. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-e1f5a9b2-ed42-4957-b2d4-0bb06cf3a5d7 req-2cb71ce8-d0b0-44a2-aa0d-51f5108ab9c3 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e1f5a9b2-ed42-4957-b2d4-0bb06cf3a5d7 req-2cb71ce8-d0b0-44a2-aa0d-51f5108ab9c3 service nova] Releasing lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUyoteZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:48:59 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:48:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:48:59 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:48:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:48:59 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:48:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3016d80e-b798-43e5-93d4-520f26cb8034]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:48:59 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:48:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0096bd-ef67-4f71-9b78-043d998e495f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5] added
Dec 01 13:49:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3e1f88-a142-472c-a20c-a3aeb2ac8297]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3658e068-f04c-4637-b2cb-1237630e4332]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUyoteZE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUyoteZE" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c92ed03-8e6f-4491-b575-49ad25b0af77]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUyoteZE'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbe8d7b-f075-4f35-9ca6-f87333a8f6cd]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed41442-246b-4d4f-8f83-faa7059135e9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de76118-523d-4bc9-befd-a89f43477043]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260]
Dec 01 13:49:00 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260] successful.
Dec 01 13:49:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a576a3fe-f3b8-457b-8b64-55b009b4b200]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a461f8f-f708-4ced-8520-9d49a9ba99a4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:49:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[527a80b4-8a72-43a6-a1ba-68558b2d454e]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUyoteZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received event network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Acquiring lock "3448c364-2dab-4110-a59f-cc973f73845c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] No waiting events found dispatching network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:00 user nova-compute[75288]: WARNING nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received unexpected event network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e for instance with vm_state building and task_state spawning.
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] No waiting events found dispatching network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:00 user nova-compute[75288]: WARNING nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received unexpected event network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 for instance with vm_state building and task_state spawning.
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] No waiting events found dispatching network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:00 user nova-compute[75288]: WARNING nova.compute.manager [req-7fa97c6e-2f4b-45f0-8f85-9c0fbaa136a4 req-73bc662a-6f80-4e6e-bd70-d32387e4f45a service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received unexpected event network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 for instance with vm_state building and task_state spawning.
Dec 01 13:49:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:00 user nova-compute[75288]: INFO nova.compute.manager [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Terminating instance
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:49:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance destroyed successfully.
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lazy-loading 'resources' on Instance uuid 2c66ff7f-d0d9-43ff-98a4-bb702780e080 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-745559289',display_name='tempest-ServerActionsTestOtherB-server-745559289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-745559289',id=5,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzL1MpDodMkY+xvBqITOaLy5oBm4DD5VJVvVNoHnn6Mtxt7m0WXVws5RbvQGMPz+LPvt+IaVJRN4WJicpVCtlvPZ8kIrh2x/RVC8OCU5xD58QPVXNLfLtbDizY9sQOGnQ==',key_name='tempest-keypair-1567478084',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd88f5d625df4e6dadf00024d504d6d1',ramdisk_id='',reservation_id='r-dxvhm1gl',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-497654762',owner_user_name='tempest-ServerActionsTestOtherB-497654762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:47:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b7739fa771e43c6b503e89ff7de7221',uuid=2c66ff7f-d0d9-43ff-98a4-bb702780e080,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Converting VIF {"id": "94a9b395-6933-43ea-89a6-77157cac1f75", "address": "fa:16:3e:1f:93:0b", "network": {"id": "40ecd6c7-4c45-4ab8-9731-3f54504cb7dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-57522546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd88f5d625df4e6dadf00024d504d6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94a9b395-69", "ovs_interfaceid": "94a9b395-6933-43ea-89a6-77157cac1f75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_vif [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94a9b395-69, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:49:00 user nova-compute[75288]: INFO os_vif [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:93:0b,bridge_name='br-int',has_traffic_filtering=True,id=94a9b395-6933-43ea-89a6-77157cac1f75,network=Network(40ecd6c7-4c45-4ab8-9731-3f54504cb7dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94a9b395-69')
Dec 01 13:49:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTOxSFkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:49:00 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:49:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23932333637616332', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932333637616332', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.388s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'flavor' on Instance uuid 64e25352-1ed2-4eda-a376-cb722f0b779f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7185a733-e177-4d07-ad64-d022328266f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:49:01 user nova-compute[75288]: No targets found.
Dec 01 13:49:01 user nova-compute[75288]: iSNS:
Dec 01 13:49:01 user nova-compute[75288]: No targets found.
Dec 01 13:49:01 user nova-compute[75288]: STATIC:
Dec 01 13:49:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:49:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:49:01 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:49:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:49:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:49:01 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:49:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:49:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:49:01 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:49:01 user nova-compute[75288]: FIRMWARE:
Dec 01 13:49:01 user nova-compute[75288]: No targets found.
Dec 01 13:49:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:49:01 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:49:01 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad18d79c-5a70-415f-bb5b-740194fc3838', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:49:01 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:49:01 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:49:01 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:49:01 user nova-compute[75288]:   <serial>0b2d4a57-112e-44c5-96bf-a5117bed88f5</serial>
Dec 01 13:49:01 user nova-compute[75288]: </disk>
Dec 01 13:49:01 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a156088-c9f7-433f-8087-add3a5a89b4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6a96bd-5fde-4042-be22-1b466689db24]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:01 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:01 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:49:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:01 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:01 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:49:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbe0366d40>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] <== disconnect_volume: return (474ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:49:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Deletion of /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize failed
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:49:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Instance spawned successfully.
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:01 user nova-compute[75288]: INFO nova.compute.manager [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Took 0.64 seconds to destroy the instance on the hypervisor.
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:49:01 user nova-compute[75288]: INFO nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Took 6.36 seconds to spawn the instance on the hypervisor.
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:49:01 user nova-compute[75288]: INFO nova.compute.manager [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Took 18.61 seconds to build instance.
Dec 01 13:49:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cd119147-b92f-4634-8520-0d8079e788e3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "3448c364-2dab-4110-a59f-cc973f73845c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.777s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:49:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No VIF found with MAC fa:16:3e:80:8b:d4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-285ad4d2-fa58-4650-a46e-4c414b32919c tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.432s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:02 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Took 0.82 seconds to deallocate network for instance.
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:49:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Instance spawned successfully.
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-a5cf9b04-597f-4d7b-a49e-f3845e025541 req-104f5f08-4ead-4660-b575-421a998b9268 service nova] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Received event network-vif-deleted-94a9b395-6933-43ea-89a6-77157cac1f75 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:02 user nova-compute[75288]: INFO nova.compute.manager [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Took 0.12 seconds to detach 1 volumes for instance.
Dec 01 13:49:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:02 user nova-compute[75288]: INFO nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Took 7.26 seconds to spawn the instance on the hypervisor.
Dec 01 13:49:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:49:02 user nova-compute[75288]: INFO nova.compute.manager [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Took 8.21 seconds to build instance.
Dec 01 13:49:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-966b5cee-8e17-422e-8092-ac2d6a2ec150 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.333s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:03 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:49:03 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:49:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:03 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Deleted allocations for instance 2c66ff7f-d0d9-43ff-98a4-bb702780e080
Dec 01 13:49:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-36bb112b-14a8-4caa-b0f6-fff88515291b tempest-ServerActionsTestOtherB-497654762 tempest-ServerActionsTestOtherB-497654762-project-member] Lock "2c66ff7f-d0d9-43ff-98a4-bb702780e080" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.516s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:03 user nova-compute[75288]: INFO nova.compute.manager [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Rebuilding instance
Dec 01 13:49:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-599a598a-eed6-4898-9179-054a1ef1cbf3 req-bcdeb380-0220-4927-a4d4-e63add45cb82 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-unplugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599a598a-eed6-4898-9179-054a1ef1cbf3 req-bcdeb380-0220-4927-a4d4-e63add45cb82 service nova] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599a598a-eed6-4898-9179-054a1ef1cbf3 req-bcdeb380-0220-4927-a4d4-e63add45cb82 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599a598a-eed6-4898-9179-054a1ef1cbf3 req-bcdeb380-0220-4927-a4d4-e63add45cb82 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-599a598a-eed6-4898-9179-054a1ef1cbf3 req-bcdeb380-0220-4927-a4d4-e63add45cb82 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] No waiting events found dispatching network-vif-unplugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:04 user nova-compute[75288]: WARNING nova.compute.manager [req-599a598a-eed6-4898-9179-054a1ef1cbf3 req-bcdeb380-0220-4927-a4d4-e63add45cb82 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received unexpected event network-vif-unplugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 for instance with vm_state active and task_state rebuilding.
Dec 01 13:49:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance destroyed successfully.
Dec 01 13:49:04 user nova-compute[75288]: INFO nova.compute.manager [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Detaching volume 0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:49:05 user nova-compute[75288]: INFO nova.virt.block_device [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Attempting to driver detach volume 0b2d4a57-112e-44c5-96bf-a5117bed88f5 from mountpoint /dev/vdb
Dec 01 13:49:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Attempting to detach device vdb from instance 64e25352-1ed2-4eda-a376-cb722f0b779f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:49:05 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:49:05 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:49:05 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:49:05 user nova-compute[75288]:   <serial>0b2d4a57-112e-44c5-96bf-a5117bed88f5</serial>
Dec 01 13:49:05 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:49:05 user nova-compute[75288]: </disk>
Dec 01 13:49:05 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:49:05 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully detached device vdb from instance 64e25352-1ed2-4eda-a376-cb722f0b779f from the persistent domain config.
Dec 01 13:49:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUyoteZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:49:05 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca2fec1-9dff-48e1-999b-9d55b2a4536a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:49:05 user nova-compute[75288]: No targets found.
Dec 01 13:49:05 user nova-compute[75288]: iSNS:
Dec 01 13:49:05 user nova-compute[75288]: No targets found.
Dec 01 13:49:05 user nova-compute[75288]: STATIC:
Dec 01 13:49:05 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:49:05 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:49:05 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:49:05 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:49:05 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:49:05 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:49:05 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:49:05 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:49:05 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:49:05 user nova-compute[75288]: FIRMWARE:
Dec 01 13:49:05 user nova-compute[75288]: No targets found.
Dec 01 13:49:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:49:05 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:49:05 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c10131-4c1e-4575-9815-b5f4a1fcbecb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e971783d-c99f-44f4-ba91-defc65fad7cd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:05 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:05 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:49:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:05 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:05 user nova-compute[75288]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:49:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ed1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fbaad8-09ef-4131-ba8b-19956f80b3ba]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9484881-c34a-41bf-8feb-7c98ac22075a]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ba64ce-4fde-42ba-8ff1-f7377821d44e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d5d59-245f-44be-9ece-1e4084687c47]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad72ca43-b1bc-4854-8edf-54a0c13a7228]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d3b694-78c5-40b9-a7a2-9cd12f898df3]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260]
Dec 01 13:49:05 user nova-compute[75288]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260] successful.
Dec 01 13:49:05 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6fc6c2-df92-4698-b0e7-c332e9dee020]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== disconnect_volume: return (394ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:06 user nova-compute[75288]: INFO nova.compute.manager [None req-05b2f6fd-5aeb-4950-ba68-6429d2df253c tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Unrescuing
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05b2f6fd-5aeb-4950-ba68-6429d2df253c tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05b2f6fd-5aeb-4950-ba68-6429d2df253c tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquired lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-05b2f6fd-5aeb-4950-ba68-6429d2df253c tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d9da167-5907-453f-a3b7-22d51030871d req-1a1ba7f9-f5ec-4997-8735-42577a5e9dcd service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d9da167-5907-453f-a3b7-22d51030871d req-1a1ba7f9-f5ec-4997-8735-42577a5e9dcd service nova] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d9da167-5907-453f-a3b7-22d51030871d req-1a1ba7f9-f5ec-4997-8735-42577a5e9dcd service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7d9da167-5907-453f-a3b7-22d51030871d req-1a1ba7f9-f5ec-4997-8735-42577a5e9dcd service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-7d9da167-5907-453f-a3b7-22d51030871d req-1a1ba7f9-f5ec-4997-8735-42577a5e9dcd service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] No waiting events found dispatching network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:06 user nova-compute[75288]: WARNING nova.compute.manager [req-7d9da167-5907-453f-a3b7-22d51030871d req-1a1ba7f9-f5ec-4997-8735-42577a5e9dcd service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received unexpected event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 for instance with vm_state active and task_state rebuilding.
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance destroyed successfully.
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-40793095',display_name='tempest-ServerActionsTestOtherA-server-1793427622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-40793095',id=15,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5j1QWrZjfkoFlcpgSGfDNOjKE6v1FOAOHJWIKiXDL1au5SABv0JByEfrULtJD5kv5INUeHAkqa5529ZSiBuaqcnIji8lw7kE1ULzkmLZbtPCUiT9YmupohdcUvXOM8jA==',key_name='tempest-keypair-546973573',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-s007j6g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=64e25352-1ed2-4eda-a376-cb722f0b779f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_vif [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap333c0000-ff, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed5d2c7c-5f1a-47ed-9a62-4b7d81fa803a) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:06 user nova-compute[75288]: INFO os_vif [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff')
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUyoteZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:49:06 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-05b2f6fd-5aeb-4950-ba68-6429d2df253c tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[637a5edb-0e70-4c11-abbb-2d7c56700041]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:49:06 user nova-compute[75288]: No targets found.
Dec 01 13:49:06 user nova-compute[75288]: iSNS:
Dec 01 13:49:06 user nova-compute[75288]: No targets found.
Dec 01 13:49:06 user nova-compute[75288]: STATIC:
Dec 01 13:49:06 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:49:06 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:49:06 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:49:06 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:49:06 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:49:06 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:49:06 user nova-compute[75288]: FIRMWARE:
Dec 01 13:49:06 user nova-compute[75288]: No targets found.
Dec 01 13:49:06 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:49:06 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:49:06 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-05b2f6fd-5aeb-4950-ba68-6429d2df253c tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Releasing lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.objects.instance [None req-05b2f6fd-5aeb-4950-ba68-6429d2df253c tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'flavor' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef03c65-f8a5-4f48-89f5-356be96be660]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f8cf6b-943f-4dbf-b325-92c2d37395b8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:06 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:06 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:06 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:06 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98eaa440>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.108s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== disconnect_volume: return (111ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:49:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:49:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Deleting instance files /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f_del
Dec 01 13:49:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Deletion of /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f_del complete
Dec 01 13:49:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:07 user nova-compute[75288]: INFO nova.virt.block_device [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Booting with volume 0b2d4a57-112e-44c5-96bf-a5117bed88f5 at /dev/vdb
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-18e42c56-6f80-4b73-9560-c0d3b778aeda req-e2b76332-f138-4a72-9206-44b4ee502493 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-18e42c56-6f80-4b73-9560-c0d3b778aeda req-e2b76332-f138-4a72-9206-44b4ee502493 service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-18e42c56-6f80-4b73-9560-c0d3b778aeda req-e2b76332-f138-4a72-9206-44b4ee502493 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-18e42c56-6f80-4b73-9560-c0d3b778aeda req-e2b76332-f138-4a72-9206-44b4ee502493 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-18e42c56-6f80-4b73-9560-c0d3b778aeda req-e2b76332-f138-4a72-9206-44b4ee502493 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:07 user nova-compute[75288]: WARNING nova.compute.manager [req-18e42c56-6f80-4b73-9560-c0d3b778aeda req-e2b76332-f138-4a72-9206-44b4ee502493 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:49:07 user nova-compute[75288]: DEBUG os_brick.utils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd44ba0e-c76d-4139-9061-2a554e70dfae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e68930c-889b-4dfe-a64e-eee46887e776]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521c440-d199-40d9-aab7-3f1a02d4bb3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b2859-ca09-4782-a400-dba80140f912]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:49:07 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193a35d-3ca9-410d-b668-004fcd8c0f43]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG os_brick.utils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updating existing volume attachment record: bdec412e-d513-474e-b317-1c4994633178 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance destroyed successfully.
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-b9a8ee7d-77fe-42ac-b61c-b1889c0175f5 req-cbe44ce0-1674-4b7d-8658-81fe3fc2b440 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-changed-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-b9a8ee7d-77fe-42ac-b61c-b1889c0175f5 req-cbe44ce0-1674-4b7d-8658-81fe3fc2b440 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Refreshing instance network info cache due to event network-changed-e41a567f-0fb6-4089-b693-d8d527576a17. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9a8ee7d-77fe-42ac-b61c-b1889c0175f5 req-cbe44ce0-1674-4b7d-8658-81fe3fc2b440 service nova] Acquiring lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9a8ee7d-77fe-42ac-b61c-b1889c0175f5 req-cbe44ce0-1674-4b7d-8658-81fe3fc2b440 service nova] Acquired lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-b9a8ee7d-77fe-42ac-b61c-b1889c0175f5 req-cbe44ce0-1674-4b7d-8658-81fe3fc2b440 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Refreshing network info cache for port e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:08 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid '64e25352-1ed2-4eda-a376-cb722f0b779f' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid '64e25352-1ed2-4eda-a376-cb722f0b779f' (instance-0000000f)
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-b9a8ee7d-77fe-42ac-b61c-b1889c0175f5 req-cbe44ce0-1674-4b7d-8658-81fe3fc2b440 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updated VIF entry in instance network info cache for port e41a567f-0fb6-4089-b693-d8d527576a17. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:49:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-b9a8ee7d-77fe-42ac-b61c-b1889c0175f5 req-cbe44ce0-1674-4b7d-8658-81fe3fc2b440 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9a8ee7d-77fe-42ac-b61c-b1889c0175f5 req-cbe44ce0-1674-4b7d-8658-81fe3fc2b440 service nova] Releasing lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-24582a6c-8f81-45dc-956d-b0b6c9b30198 req-4e679325-02ff-4ac3-bc6c-b757c193b908 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-24582a6c-8f81-45dc-956d-b0b6c9b30198 req-4e679325-02ff-4ac3-bc6c-b757c193b908 service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-24582a6c-8f81-45dc-956d-b0b6c9b30198 req-4e679325-02ff-4ac3-bc6c-b757c193b908 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-24582a6c-8f81-45dc-956d-b0b6c9b30198 req-4e679325-02ff-4ac3-bc6c-b757c193b908 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-24582a6c-8f81-45dc-956d-b0b6c9b30198 req-4e679325-02ff-4ac3-bc6c-b757c193b908 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:09 user nova-compute[75288]: WARNING nova.compute.manager [req-24582a6c-8f81-45dc-956d-b0b6c9b30198 req-4e679325-02ff-4ac3-bc6c-b757c193b908 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a34996b-faff-416a-89db-532dedace1a2 req-6011f992-5f41-46ac-a05a-be28c44e4671 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-changed-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-6a34996b-faff-416a-89db-532dedace1a2 req-6011f992-5f41-46ac-a05a-be28c44e4671 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Refreshing instance network info cache due to event network-changed-e41a567f-0fb6-4089-b693-d8d527576a17. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a34996b-faff-416a-89db-532dedace1a2 req-6011f992-5f41-46ac-a05a-be28c44e4671 service nova] Acquiring lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a34996b-faff-416a-89db-532dedace1a2 req-6011f992-5f41-46ac-a05a-be28c44e4671 service nova] Acquired lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG nova.network.neutron [req-6a34996b-faff-416a-89db-532dedace1a2 req-6011f992-5f41-46ac-a05a-be28c44e4671 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Refreshing network info cache for port e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-6a34996b-faff-416a-89db-532dedace1a2 req-6011f992-5f41-46ac-a05a-be28c44e4671 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updated VIF entry in instance network info cache for port e41a567f-0fb6-4089-b693-d8d527576a17. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-6a34996b-faff-416a-89db-532dedace1a2 req-6011f992-5f41-46ac-a05a-be28c44e4671 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [{"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6a34996b-faff-416a-89db-532dedace1a2 req-6011f992-5f41-46ac-a05a-be28c44e4671 service nova] Releasing lock "refresh_cache-f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:11 user nova-compute[75288]: WARNING nova.compute.manager [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:49:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:11 user nova-compute[75288]: WARNING nova.compute.manager [req-599d3152-a96c-4f8b-9a2f-674f69018794 req-fe0ac17f-3980-4acc-995e-b4ebc7736f24 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:49:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-05b2f6fd-5aeb-4950-ba68-6429d2df253c tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:49:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:49:12 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:49:12 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:49:12 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=25.28475570678711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:49:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0ab72540-6333-4a3b-bb5f-411e607bac1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 64e25352-1ed2-4eda-a376-cb722f0b779f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d000b879-6b79-4f80-a69d-548d8108c1ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2cc53f02-69ec-4302-b972-8fad7ad0e831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 3448c364-2dab-4110-a59f-cc973f73845c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b6118993-49ad-4e01-8b70-e79eaf510b59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing inventories for resource provider 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating ProviderTree inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing aggregate associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing trait associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.168s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 13:49:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance has had 1 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Dec 01 13:49:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Deletion of /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize failed
Dec 01 13:49:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 13:49:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:49:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:49:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:49:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updating instance_info_cache with network_info: [{"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-0ab72540-6333-4a3b-bb5f-411e607bac1d" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:49:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:49:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Creating image(s)
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.222s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk 1073741824" returned: 0 in 0.059s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:49:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Cannot resize image /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Ensure instance console log exists: /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Start _get_guest_xml network_info=[{"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bdec412e-d513-474e-b317-1c4994633178', 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUyoteZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64e25352-1ed2-4eda-a376-cb722f0b779f', 'attached_at': '', 'detached_at': '', 'volume_id': '0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'serial': '0b2d4a57-112e-44c5-96bf-a5117bed88f5'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:49:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 13:49:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.objects.instance [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64e25352-1ed2-4eda-a376-cb722f0b779f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUyoteZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:49:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:49:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:49:20 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3144e5-d04d-4692-a9b1-9e64bffa23f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:49:20 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c21b48b-696a-4aee-be8a-7fda7ad5a0cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5] added
Dec 01 13:49:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2059e3-9fe3-4aae-b833-0d9f5fffefeb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2621a7e-4d23-4220-8ed0-2c1310a467ff]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUyoteZE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mUyoteZE" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[90968ba1-6745-42d2-b3b8-99c1bf910d91]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mUyoteZE'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[539de498-6f44-4b52-8340-5612e3931228]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ff0126-5d43-46e3-8744-934902f2b1d9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a611487-e2b4-4914-9e28-86fa138a5168]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260]
Dec 01 13:49:20 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260] successful.
Dec 01 13:49:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa6e984-d7f6-43c2-9e4f-8194058671ef]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[21132de1-290b-4e40-b73f-e08b96de17e5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:49:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdd8b38-0a84-4c3c-933f-fc34468ea6cb]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:49:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUyoteZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "e6194101-1671-4beb-bc96-ed503be7fb72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "e6194101-1671-4beb-bc96-ed503be7fb72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:49:21 user nova-compute[75288]: INFO nova.compute.claims [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Claim successful on node user
Dec 01 13:49:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23932333637616332', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932333637616332', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T13:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-40793095',display_name='tempest-ServerActionsTestOtherA-server-1793427622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-40793095',id=15,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5j1QWrZjfkoFlcpgSGfDNOjKE6v1FOAOHJWIKiXDL1au5SABv0JByEfrULtJD5kv5INUeHAkqa5529ZSiBuaqcnIji8lw7kE1ULzkmLZbtPCUiT9YmupohdcUvXOM8jA==',key_name='tempest-keypair-546973573',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-s007j6g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=64e25352-1ed2-4eda-a376-cb722f0b779f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:49:21 user nova-compute[75288]:   <uuid>64e25352-1ed2-4eda-a376-cb722f0b779f</uuid>
Dec 01 13:49:21 user nova-compute[75288]:   <name>instance-0000000f</name>
Dec 01 13:49:21 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:49:21 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:49:21 user nova-compute[75288]:   <metadata>
Dec 01 13:49:21 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:49:21 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:49:21 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherA-server-1793427622</nova:name>
Dec 01 13:49:21 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:49:20</nova:creationTime>
Dec 01 13:49:21 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:49:21 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:49:21 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:49:21 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:49:21 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:49:21 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:49:21 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:49:21 user nova-compute[75288]:       <nova:owner>
Dec 01 13:49:21 user nova-compute[75288]:         <nova:user uuid="5a8b600efb9d47b6991cbde8b34b9a1f">tempest-ServerActionsTestOtherA-1200563250-project-member</nova:user>
Dec 01 13:49:21 user nova-compute[75288]:         <nova:project uuid="85fa93e7dad94355a81ee3193a26d19a">tempest-ServerActionsTestOtherA-1200563250</nova:project>
Dec 01 13:49:21 user nova-compute[75288]:       </nova:owner>
Dec 01 13:49:21 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:49:21 user nova-compute[75288]:       <nova:ports>
Dec 01 13:49:21 user nova-compute[75288]:         <nova:port uuid="333c0000-ff58-4863-9d8e-0ddb10c68fd4">
Dec 01 13:49:21 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 13:49:21 user nova-compute[75288]:         </nova:port>
Dec 01 13:49:21 user nova-compute[75288]:       </nova:ports>
Dec 01 13:49:21 user nova-compute[75288]:     </nova:instance>
Dec 01 13:49:21 user nova-compute[75288]:   </metadata>
Dec 01 13:49:21 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:49:21 user nova-compute[75288]:     <system>
Dec 01 13:49:21 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:49:21 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:49:21 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:49:21 user nova-compute[75288]:       <entry name="serial">64e25352-1ed2-4eda-a376-cb722f0b779f</entry>
Dec 01 13:49:21 user nova-compute[75288]:       <entry name="uuid">64e25352-1ed2-4eda-a376-cb722f0b779f</entry>
Dec 01 13:49:21 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:49:21 user nova-compute[75288]:     </system>
Dec 01 13:49:21 user nova-compute[75288]:   </sysinfo>
Dec 01 13:49:21 user nova-compute[75288]:   <os>
Dec 01 13:49:21 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:49:21 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:49:21 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:49:21 user nova-compute[75288]:   </os>
Dec 01 13:49:21 user nova-compute[75288]:   <features>
Dec 01 13:49:21 user nova-compute[75288]:     <acpi/>
Dec 01 13:49:21 user nova-compute[75288]:     <apic/>
Dec 01 13:49:21 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:49:21 user nova-compute[75288]:   </features>
Dec 01 13:49:21 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:49:21 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:49:21 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:49:21 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:49:21 user nova-compute[75288]:   </clock>
Dec 01 13:49:21 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:49:21 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:49:21 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:49:21 user nova-compute[75288]:   </cpu>
Dec 01 13:49:21 user nova-compute[75288]:   <devices>
Dec 01 13:49:21 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:49:21 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:49:21 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk"/>
Dec 01 13:49:21 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:49:21 user nova-compute[75288]:     </disk>
Dec 01 13:49:21 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:49:21 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:49:21 user nova-compute[75288]:       <source dev="/dev/sdd"/>
Dec 01 13:49:21 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 13:49:21 user nova-compute[75288]:       <serial>0b2d4a57-112e-44c5-96bf-a5117bed88f5</serial>
Dec 01 13:49:21 user nova-compute[75288]:     </disk>
Dec 01 13:49:21 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:49:21 user nova-compute[75288]:       <mac address="fa:16:3e:80:8b:d4"/>
Dec 01 13:49:21 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:49:21 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:49:21 user nova-compute[75288]:       <target dev="tap333c0000-ff"/>
Dec 01 13:49:21 user nova-compute[75288]:     </interface>
Dec 01 13:49:21 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:49:21 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/console.log" append="off"/>
Dec 01 13:49:21 user nova-compute[75288]:     </serial>
Dec 01 13:49:21 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:49:21 user nova-compute[75288]:     <video>
Dec 01 13:49:21 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:49:21 user nova-compute[75288]:     </video>
Dec 01 13:49:21 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:49:21 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:49:21 user nova-compute[75288]:     </rng>
Dec 01 13:49:21 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:49:21 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:49:21 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:49:21 user nova-compute[75288]:     </memballoon>
Dec 01 13:49:21 user nova-compute[75288]:   </devices>
Dec 01 13:49:21 user nova-compute[75288]: </domain>
Dec 01 13:49:21 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T13:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-40793095',display_name='tempest-ServerActionsTestOtherA-server-1793427622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-40793095',id=15,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5j1QWrZjfkoFlcpgSGfDNOjKE6v1FOAOHJWIKiXDL1au5SABv0JByEfrULtJD5kv5INUeHAkqa5529ZSiBuaqcnIji8lw7kE1ULzkmLZbtPCUiT9YmupohdcUvXOM8jA==',key_name='tempest-keypair-546973573',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-s007j6g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=64e25352-1ed2-4eda-a376-cb722f0b779f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG os_vif [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ff1ce45-c246-56a8-88b4-4a1a9db12318', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap333c0000-ff, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap333c0000-ff, col_values=(('qos', UUID('7faf36a4-4dfa-4e37-8d2e-a07cd0956edf')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap333c0000-ff, col_values=(('external_ids', {'iface-id': '333c0000-ff58-4863-9d8e-0ddb10c68fd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:8b:d4', 'vm-uuid': '64e25352-1ed2-4eda-a376-cb722f0b779f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:21 user nova-compute[75288]: INFO os_vif [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff')
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No VIF found with MAC fa:16:3e:80:8b:d4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:49:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:49:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.policy [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e46a79987bb4308bdaea741c1a56d0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f01054a7fd41c1b36119582feb288a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:49:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Creating image(s)
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "/opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "/opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk 1073741824" returned: 0 in 0.059s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Successfully created port: b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Cannot resize image /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Ensure instance console log exists: /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-665f7291-21d9-463c-bded-2e9cba76236c req-0a3959cd-d28e-4f06-8845-6593758424ec service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-665f7291-21d9-463c-bded-2e9cba76236c req-0a3959cd-d28e-4f06-8845-6593758424ec service nova] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-665f7291-21d9-463c-bded-2e9cba76236c req-0a3959cd-d28e-4f06-8845-6593758424ec service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-665f7291-21d9-463c-bded-2e9cba76236c req-0a3959cd-d28e-4f06-8845-6593758424ec service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-665f7291-21d9-463c-bded-2e9cba76236c req-0a3959cd-d28e-4f06-8845-6593758424ec service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] No waiting events found dispatching network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:23 user nova-compute[75288]: WARNING nova.compute.manager [req-665f7291-21d9-463c-bded-2e9cba76236c req-0a3959cd-d28e-4f06-8845-6593758424ec service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received unexpected event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 13:49:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Successfully updated port: b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "refresh_cache-e6194101-1671-4beb-bc96-ed503be7fb72" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquired lock "refresh_cache-e6194101-1671-4beb-bc96-ed503be7fb72" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:49:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Updating instance_info_cache with network_info: [{"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Releasing lock "refresh_cache-e6194101-1671-4beb-bc96-ed503be7fb72" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Instance network_info: |[{"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Start _get_guest_xml network_info=[{"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:49:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:49:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-685921034',display_name='tempest-VolumesActionsTest-instance-685921034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-685921034',id=22,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34f01054a7fd41c1b36119582feb288a',ramdisk_id='',reservation_id='r-4icu5tzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-589432163',owner_user_name='tempest-VolumesActionsTest-589432163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:49:22Z,user_data=None,user_id='7e46a79987bb4308bdaea741c1a56d0a',uuid=e6194101-1671-4beb-bc96-ed503be7fb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Converting VIF {"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:0f,bridge_name='br-int',has_traffic_filtering=True,id=b65733e1-ad7b-4afa-875d-56f147b4a252,network=Network(5d90384e-bdca-46ab-b74d-5d2eb638825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65733e1-ad') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.objects.instance [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lazy-loading 'pci_devices' on Instance uuid e6194101-1671-4beb-bc96-ed503be7fb72 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:49:24 user nova-compute[75288]:   <uuid>e6194101-1671-4beb-bc96-ed503be7fb72</uuid>
Dec 01 13:49:24 user nova-compute[75288]:   <name>instance-00000016</name>
Dec 01 13:49:24 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:49:24 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:49:24 user nova-compute[75288]:   <metadata>
Dec 01 13:49:24 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:49:24 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:49:24 user nova-compute[75288]:       <nova:name>tempest-VolumesActionsTest-instance-685921034</nova:name>
Dec 01 13:49:24 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:49:24</nova:creationTime>
Dec 01 13:49:24 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:49:24 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:49:24 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:49:24 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:49:24 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:49:24 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:49:24 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:49:24 user nova-compute[75288]:       <nova:owner>
Dec 01 13:49:24 user nova-compute[75288]:         <nova:user uuid="7e46a79987bb4308bdaea741c1a56d0a">tempest-VolumesActionsTest-589432163-project-member</nova:user>
Dec 01 13:49:24 user nova-compute[75288]:         <nova:project uuid="34f01054a7fd41c1b36119582feb288a">tempest-VolumesActionsTest-589432163</nova:project>
Dec 01 13:49:24 user nova-compute[75288]:       </nova:owner>
Dec 01 13:49:24 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:49:24 user nova-compute[75288]:       <nova:ports>
Dec 01 13:49:24 user nova-compute[75288]:         <nova:port uuid="b65733e1-ad7b-4afa-875d-56f147b4a252">
Dec 01 13:49:24 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 13:49:24 user nova-compute[75288]:         </nova:port>
Dec 01 13:49:24 user nova-compute[75288]:       </nova:ports>
Dec 01 13:49:24 user nova-compute[75288]:     </nova:instance>
Dec 01 13:49:24 user nova-compute[75288]:   </metadata>
Dec 01 13:49:24 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:49:24 user nova-compute[75288]:     <system>
Dec 01 13:49:24 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:49:24 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:49:24 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:49:24 user nova-compute[75288]:       <entry name="serial">e6194101-1671-4beb-bc96-ed503be7fb72</entry>
Dec 01 13:49:24 user nova-compute[75288]:       <entry name="uuid">e6194101-1671-4beb-bc96-ed503be7fb72</entry>
Dec 01 13:49:24 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:49:24 user nova-compute[75288]:     </system>
Dec 01 13:49:24 user nova-compute[75288]:   </sysinfo>
Dec 01 13:49:24 user nova-compute[75288]:   <os>
Dec 01 13:49:24 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:49:24 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:49:24 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:49:24 user nova-compute[75288]:   </os>
Dec 01 13:49:24 user nova-compute[75288]:   <features>
Dec 01 13:49:24 user nova-compute[75288]:     <acpi/>
Dec 01 13:49:24 user nova-compute[75288]:     <apic/>
Dec 01 13:49:24 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:49:24 user nova-compute[75288]:   </features>
Dec 01 13:49:24 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:49:24 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:49:24 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:49:24 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:49:24 user nova-compute[75288]:   </clock>
Dec 01 13:49:24 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:49:24 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:49:24 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:49:24 user nova-compute[75288]:   </cpu>
Dec 01 13:49:24 user nova-compute[75288]:   <devices>
Dec 01 13:49:24 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:49:24 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:49:24 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk"/>
Dec 01 13:49:24 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:49:24 user nova-compute[75288]:     </disk>
Dec 01 13:49:24 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:49:24 user nova-compute[75288]:       <mac address="fa:16:3e:3d:23:0f"/>
Dec 01 13:49:24 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:49:24 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:49:24 user nova-compute[75288]:       <target dev="tapb65733e1-ad"/>
Dec 01 13:49:24 user nova-compute[75288]:     </interface>
Dec 01 13:49:24 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:49:24 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/console.log" append="off"/>
Dec 01 13:49:24 user nova-compute[75288]:     </serial>
Dec 01 13:49:24 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:49:24 user nova-compute[75288]:     <video>
Dec 01 13:49:24 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:49:24 user nova-compute[75288]:     </video>
Dec 01 13:49:24 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:49:24 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:49:24 user nova-compute[75288]:     </rng>
Dec 01 13:49:24 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:49:24 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:49:24 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:49:24 user nova-compute[75288]:     </memballoon>
Dec 01 13:49:24 user nova-compute[75288]:   </devices>
Dec 01 13:49:24 user nova-compute[75288]: </domain>
Dec 01 13:49:24 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-685921034',display_name='tempest-VolumesActionsTest-instance-685921034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-685921034',id=22,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34f01054a7fd41c1b36119582feb288a',ramdisk_id='',reservation_id='r-4icu5tzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-589432163',owner_user_name='tempest-VolumesActionsTest-589432163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:49:22Z,user_data=None,user_id='7e46a79987bb4308bdaea741c1a56d0a',uuid=e6194101-1671-4beb-bc96-ed503be7fb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Converting VIF {"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:0f,bridge_name='br-int',has_traffic_filtering=True,id=b65733e1-ad7b-4afa-875d-56f147b4a252,network=Network(5d90384e-bdca-46ab-b74d-5d2eb638825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65733e1-ad') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG os_vif [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:0f,bridge_name='br-int',has_traffic_filtering=True,id=b65733e1-ad7b-4afa-875d-56f147b4a252,network=Network(5d90384e-bdca-46ab-b74d-5d2eb638825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65733e1-ad') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b677dc8-7dd7-5f90-8597-68f4b5661cdf', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb65733e1-ad, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb65733e1-ad, col_values=(('qos', UUID('ee500f11-a215-4736-8ab7-1fe827f1356f')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb65733e1-ad, col_values=(('external_ids', {'iface-id': 'b65733e1-ad7b-4afa-875d-56f147b4a252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:23:0f', 'vm-uuid': 'e6194101-1671-4beb-bc96-ed503be7fb72'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:24 user nova-compute[75288]: INFO os_vif [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:0f,bridge_name='br-int',has_traffic_filtering=True,id=b65733e1-ad7b-4afa-875d-56f147b4a252,network=Network(5d90384e-bdca-46ab-b74d-5d2eb638825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65733e1-ad')
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:49:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] No VIF found with MAC fa:16:3e:3d:23:0f, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:49:25 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance spawned successfully.
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received event network-changed-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Refreshing instance network info cache due to event network-changed-b65733e1-ad7b-4afa-875d-56f147b4a252. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] Acquiring lock "refresh_cache-e6194101-1671-4beb-bc96-ed503be7fb72" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] Acquired lock "refresh_cache-e6194101-1671-4beb-bc96-ed503be7fb72" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Refreshing network info cache for port b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.objects.instance [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75288) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-448cdc07-4fd1-4b6a-840d-3afb69003c32 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.117s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Updated VIF entry in instance network info cache for port b65733e1-ad7b-4afa-875d-56f147b4a252. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Updating instance_info_cache with network_info: [{"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] Releasing lock "refresh_cache-e6194101-1671-4beb-bc96-ed503be7fb72" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] No waiting events found dispatching network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:25 user nova-compute[75288]: WARNING nova.compute.manager [req-382ff9f1-1c1f-4b4d-a7f0-e7a9c0bad0e6 req-b1f01241-d5c2-4c99-8652-d6379a5ef212 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received unexpected event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 13:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-1934b03f-2da6-48c7-8bfc-9e23a79dcfa7 req-35482191-02e9-4d1b-b70d-38a28a5c03a2 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received event network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1934b03f-2da6-48c7-8bfc-9e23a79dcfa7 req-35482191-02e9-4d1b-b70d-38a28a5c03a2 service nova] Acquiring lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1934b03f-2da6-48c7-8bfc-9e23a79dcfa7 req-35482191-02e9-4d1b-b70d-38a28a5c03a2 service nova] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1934b03f-2da6-48c7-8bfc-9e23a79dcfa7 req-35482191-02e9-4d1b-b70d-38a28a5c03a2 service nova] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-1934b03f-2da6-48c7-8bfc-9e23a79dcfa7 req-35482191-02e9-4d1b-b70d-38a28a5c03a2 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] No waiting events found dispatching network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:26 user nova-compute[75288]: WARNING nova.compute.manager [req-1934b03f-2da6-48c7-8bfc-9e23a79dcfa7 req-35482191-02e9-4d1b-b70d-38a28a5c03a2 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received unexpected event network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 for instance with vm_state building and task_state spawning.
Dec 01 13:49:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-2e935a8e-d59b-4eb1-b635-9b63db0a4b75 req-779112c2-fd80-4206-b833-663101138a1d service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received event network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2e935a8e-d59b-4eb1-b635-9b63db0a4b75 req-779112c2-fd80-4206-b833-663101138a1d service nova] Acquiring lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2e935a8e-d59b-4eb1-b635-9b63db0a4b75 req-779112c2-fd80-4206-b833-663101138a1d service nova] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2e935a8e-d59b-4eb1-b635-9b63db0a4b75 req-779112c2-fd80-4206-b833-663101138a1d service nova] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-2e935a8e-d59b-4eb1-b635-9b63db0a4b75 req-779112c2-fd80-4206-b833-663101138a1d service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] No waiting events found dispatching network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:28 user nova-compute[75288]: WARNING nova.compute.manager [req-2e935a8e-d59b-4eb1-b635-9b63db0a4b75 req-779112c2-fd80-4206-b833-663101138a1d service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received unexpected event network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 for instance with vm_state building and task_state spawning.
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:49:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Instance spawned successfully.
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:49:28 user nova-compute[75288]: INFO nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Took 6.38 seconds to spawn the instance on the hypervisor.
Dec 01 13:49:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:49:28 user nova-compute[75288]: INFO nova.compute.manager [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Took 7.22 seconds to build instance.
Dec 01 13:49:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-057ac64e-ca81-4878-925a-6c88616e4629 tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "e6194101-1671-4beb-bc96-ed503be7fb72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.310s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:40 user nova-compute[75288]: INFO nova.compute.manager [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Detaching volume 8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:49:40 user nova-compute[75288]: INFO nova.virt.block_device [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Attempting to driver detach volume 8b89ddf0-7d91-4798-a7a7-b8bae33bf175 from mountpoint /dev/vdb
Dec 01 13:49:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Attempting to detach device vdb from instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:49:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:49:40 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:49:40 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:49:40 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:49:40 user nova-compute[75288]:   <serial>8b89ddf0-7d91-4798-a7a7-b8bae33bf175</serial>
Dec 01 13:49:40 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:49:40 user nova-compute[75288]: </disk>
Dec 01 13:49:40 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:49:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Successfully detached device vdb from instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af from the persistent domain config.
Dec 01 13:49:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:49:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:49:40 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:49:40 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:49:40 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:49:40 user nova-compute[75288]:   <serial>8b89ddf0-7d91-4798-a7a7-b8bae33bf175</serial>
Dec 01 13:49:40 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:49:40 user nova-compute[75288]: </disk>
Dec 01 13:49:40 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:49:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:49:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:46 user nova-compute[75288]: INFO nova.compute.manager [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Terminating instance
Dec 01 13:49:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-12d35932-4783-4f5f-b2de-822785f10691 req-10af3d5e-dea7-4b8d-ba6a-e5046e0208f7 service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received event network-vif-unplugged-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12d35932-4783-4f5f-b2de-822785f10691 req-10af3d5e-dea7-4b8d-ba6a-e5046e0208f7 service nova] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12d35932-4783-4f5f-b2de-822785f10691 req-10af3d5e-dea7-4b8d-ba6a-e5046e0208f7 service nova] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12d35932-4783-4f5f-b2de-822785f10691 req-10af3d5e-dea7-4b8d-ba6a-e5046e0208f7 service nova] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-12d35932-4783-4f5f-b2de-822785f10691 req-10af3d5e-dea7-4b8d-ba6a-e5046e0208f7 service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] No waiting events found dispatching network-vif-unplugged-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-12d35932-4783-4f5f-b2de-822785f10691 req-10af3d5e-dea7-4b8d-ba6a-e5046e0208f7 service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received event network-vif-unplugged-36f04c68-844f-43a3-956e-3a484a23b4c3 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:49:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Instance destroyed successfully.
Dec 01 13:49:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lazy-loading 'resources' on Instance uuid 0ab72540-6333-4a3b-bb5f-411e607bac1d {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1035200767',display_name='tempest-VolumesAdminNegativeTest-server-1035200767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1035200767',id=7,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAT9AAsXFj5Sg8X0qNYEVaQMEzRsDfpY8RQeNr5EqpmMr2GZMVJ9jdJRVbtj6OcOXvgkc/UjHEOCSIPRS+oi1I33JT5GEEoe8IzzudbcALZBOIJj02TKZAgLFeSKVzkfw==',key_name='tempest-keypair-652508006',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d820dd1ad9d42229c9537044fd32cbb',ramdisk_id='',reservation_id='r-7flupfw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1728786286',owner_user_name='tempest-VolumesAdminNegativeTest-1728786286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:43:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14b041e05644358b3365ca675a93cfe',uuid=0ab72540-6333-4a3b-bb5f-411e607bac1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converting VIF {"id": "36f04c68-844f-43a3-956e-3a484a23b4c3", "address": "fa:16:3e:a8:95:07", "network": {"id": "f18ae2da-2eba-4152-9c85-2c6cb3d22aaf", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-855637718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d820dd1ad9d42229c9537044fd32cbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04c68-84", "ovs_interfaceid": "36f04c68-844f-43a3-956e-3a484a23b4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:95:07,bridge_name='br-int',has_traffic_filtering=True,id=36f04c68-844f-43a3-956e-3a484a23b4c3,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04c68-84') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:49:46 user nova-compute[75288]: DEBUG os_vif [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:95:07,bridge_name='br-int',has_traffic_filtering=True,id=36f04c68-844f-43a3-956e-3a484a23b4c3,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04c68-84') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36f04c68-84, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3e42411-c341-4e56-a2b6-26e0cbd4f7a3) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:47 user nova-compute[75288]: INFO os_vif [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:95:07,bridge_name='br-int',has_traffic_filtering=True,id=36f04c68-844f-43a3-956e-3a484a23b4c3,network=Network(f18ae2da-2eba-4152-9c85-2c6cb3d22aaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04c68-84')
Dec 01 13:49:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Deleting instance files /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d_del
Dec 01 13:49:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Deletion of /opt/stack/data/nova/instances/0ab72540-6333-4a3b-bb5f-411e607bac1d_del complete
Dec 01 13:49:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:47 user nova-compute[75288]: INFO nova.compute.manager [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 01 13:49:47 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:47 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Took 0.68 seconds to deallocate network for instance.
Dec 01 13:49:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-da588b61-a9f4-460b-b583-2109d9377fcc req-e3dac424-ede8-4655-b5b9-5144e2926dee service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received event network-vif-deleted-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:47 user nova-compute[75288]: INFO nova.compute.manager [req-da588b61-a9f4-460b-b583-2109d9377fcc req-e3dac424-ede8-4655-b5b9-5144e2926dee service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Neutron deleted interface 36f04c68-844f-43a3-956e-3a484a23b4c3; detaching it from the instance and deleting it from the info cache
Dec 01 13:49:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-da588b61-a9f4-460b-b583-2109d9377fcc req-e3dac424-ede8-4655-b5b9-5144e2926dee service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-da588b61-a9f4-460b-b583-2109d9377fcc req-e3dac424-ede8-4655-b5b9-5144e2926dee service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Detach interface failed, port_id=36f04c68-844f-43a3-956e-3a484a23b4c3, reason: Instance 0ab72540-6333-4a3b-bb5f-411e607bac1d could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:48 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Deleted allocations for instance 0ab72540-6333-4a3b-bb5f-411e607bac1d
Dec 01 13:49:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e07124e5-8314-4413-9c26-a578d5f1c2cc tempest-VolumesAdminNegativeTest-1728786286 tempest-VolumesAdminNegativeTest-1728786286-project-member] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.205s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:48 user nova-compute[75288]: INFO nova.compute.manager [None req-1be1b35c-e8ae-482b-a87f-4e4321d63dec tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Unrescuing
Dec 01 13:49:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1be1b35c-e8ae-482b-a87f-4e4321d63dec tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1be1b35c-e8ae-482b-a87f-4e4321d63dec tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquired lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1be1b35c-e8ae-482b-a87f-4e4321d63dec tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-26cf8ffd-c878-4cfa-b24e-c4982379cb3d req-3424653a-4262-4f25-acca-7e80976fe787 service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received event network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26cf8ffd-c878-4cfa-b24e-c4982379cb3d req-3424653a-4262-4f25-acca-7e80976fe787 service nova] Acquiring lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26cf8ffd-c878-4cfa-b24e-c4982379cb3d req-3424653a-4262-4f25-acca-7e80976fe787 service nova] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26cf8ffd-c878-4cfa-b24e-c4982379cb3d req-3424653a-4262-4f25-acca-7e80976fe787 service nova] Lock "0ab72540-6333-4a3b-bb5f-411e607bac1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-26cf8ffd-c878-4cfa-b24e-c4982379cb3d req-3424653a-4262-4f25-acca-7e80976fe787 service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] No waiting events found dispatching network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:48 user nova-compute[75288]: WARNING nova.compute.manager [req-26cf8ffd-c878-4cfa-b24e-c4982379cb3d req-3424653a-4262-4f25-acca-7e80976fe787 service nova] [instance: 0ab72540-6333-4a3b-bb5f-411e607bac1d] Received unexpected event network-vif-plugged-36f04c68-844f-43a3-956e-3a484a23b4c3 for instance with vm_state deleted and task_state None.
Dec 01 13:49:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-1be1b35c-e8ae-482b-a87f-4e4321d63dec tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:49:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1be1b35c-e8ae-482b-a87f-4e4321d63dec tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Releasing lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:49:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1be1b35c-e8ae-482b-a87f-4e4321d63dec tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'flavor' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:49:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance destroyed successfully.
Dec 01 13:49:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:50 user nova-compute[75288]: WARNING nova.compute.manager [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:49:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:50 user nova-compute[75288]: WARNING nova.compute.manager [req-85fedefb-02ad-4f39-bc31-502e0a2f22d2 req-7966f57b-7e5a-4108-ad4a-26cc62087f21 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:49:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:51 user nova-compute[75288]: INFO nova.compute.manager [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] instance snapshotting
Dec 01 13:49:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Beginning live snapshot process
Dec 01 13:49:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpo1i4x9yn/c14d72a69b7a4c67b285519137661f6a.delta 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpo1i4x9yn/c14d72a69b7a4c67b285519137661f6a.delta 1073741824" returned: 0 in 0.064s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 13:49:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] COPY block job progress, current cursor: 22151168 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:53 user nova-compute[75288]: WARNING nova.compute.manager [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:49:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:49:53 user nova-compute[75288]: WARNING nova.compute.manager [req-45688bee-0950-40e7-8098-ea5ed56ccd91 req-dd6458b6-f07f-470b-980f-8a91ab6b7295 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:49:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:49:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 13:49:53 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpo1i4x9yn/c14d72a69b7a4c67b285519137661f6a.delta /opt/stack/data/nova/instances/snapshots/tmpo1i4x9yn/c14d72a69b7a4c67b285519137661f6a {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:49:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1be1b35c-e8ae-482b-a87f-4e4321d63dec tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:49:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpo1i4x9yn/c14d72a69b7a4c67b285519137661f6a.delta /opt/stack/data/nova/instances/snapshots/tmpo1i4x9yn/c14d72a69b7a4c67b285519137661f6a" returned: 0 in 0.580s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:49:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Snapshot extracted, beginning image upload
Dec 01 13:49:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:49:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Snapshot image upload complete
Dec 01 13:49:57 user nova-compute[75288]: INFO nova.compute.manager [None req-fa893db2-644f-4e6e-b573-87a8fbf73c57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Took 6.23 seconds to snapshot the instance on the hypervisor.
Dec 01 13:49:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-04b6d813-c79f-4156-98f6-91fb7079fc8d req-596c5910-b1fa-45e6-8e27-fb77157b10bb service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received event network-changed-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:49:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-04b6d813-c79f-4156-98f6-91fb7079fc8d req-596c5910-b1fa-45e6-8e27-fb77157b10bb service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Refreshing instance network info cache due to event network-changed-f515fe97-64dc-4a0c-89e7-0378f1d90379. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-04b6d813-c79f-4156-98f6-91fb7079fc8d req-596c5910-b1fa-45e6-8e27-fb77157b10bb service nova] Acquiring lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:49:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-04b6d813-c79f-4156-98f6-91fb7079fc8d req-596c5910-b1fa-45e6-8e27-fb77157b10bb service nova] Acquired lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:49:59 user nova-compute[75288]: DEBUG nova.network.neutron [req-04b6d813-c79f-4156-98f6-91fb7079fc8d req-596c5910-b1fa-45e6-8e27-fb77157b10bb service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Refreshing network info cache for port f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:49:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-04b6d813-c79f-4156-98f6-91fb7079fc8d req-596c5910-b1fa-45e6-8e27-fb77157b10bb service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Updated VIF entry in instance network info cache for port f515fe97-64dc-4a0c-89e7-0378f1d90379. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:50:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-04b6d813-c79f-4156-98f6-91fb7079fc8d req-596c5910-b1fa-45e6-8e27-fb77157b10bb service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Updating instance_info_cache with network_info: [{"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-04b6d813-c79f-4156-98f6-91fb7079fc8d req-596c5910-b1fa-45e6-8e27-fb77157b10bb service nova] Releasing lock "refresh_cache-d000b879-6b79-4f80-a69d-548d8108c1ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:01 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af is timed out.
Dec 01 13:50:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Successfully detached device vdb from instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af from the live domain config.
Dec 01 13:50:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYtoIhrP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:01 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a0b985-377f-45ab-aa67-597087011138]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:50:01 user nova-compute[75288]: No targets found.
Dec 01 13:50:01 user nova-compute[75288]: iSNS:
Dec 01 13:50:01 user nova-compute[75288]: No targets found.
Dec 01 13:50:01 user nova-compute[75288]: STATIC:
Dec 01 13:50:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:50:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:01 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175
Dec 01 13:50:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:01 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:01 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:50:01 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:01 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:01 user nova-compute[75288]: FIRMWARE:
Dec 01 13:50:01 user nova-compute[75288]: No targets found.
Dec 01 13:50:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:50:01 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:50:01 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c195d7-b169-4427-a975-0e2496264a0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[111885cb-0ab0-4f41-9bb8-c854fbb3bc77]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:50:01 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:01 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 (non-flash)
Dec 01 13:50:01 user nova-compute[75288]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:01 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ed3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d9bd8-946e-4c65-a4bd-ff795524ce8e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa0358-fda5-49f8-8494-80f6c2f2e608]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bfb549-cb05-4e7d-b605-e7cb7a9db3ea]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fb1fd5-1ac9-4d22-9d42-6e00dc534ea4]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c763dd-6950-4333-bdb6-93134c5939d2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e7e6ff-a79e-4b6e-b146-23d086700c46]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175, portal: 172.16.0.220,3260]
Dec 01 13:50:01 user nova-compute[75288]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175, portal: 172.16.0.220,3260] successful.
Dec 01 13:50:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b89ddf0-7d91-4798-a7a7-b8bae33bf175 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e72d1f-578a-4c4b-b0a2-2da73c53234b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] <== disconnect_volume: return (368ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lazy-loading 'flavor' on Instance uuid d000b879-6b79-4f80-a69d-548d8108c1ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:02 user nova-compute[75288]: INFO nova.compute.manager [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Attaching volume 5f390977-0aeb-4c8d-97ab-def02c3a2b17 to /dev/vdb
Dec 01 13:50:02 user nova-compute[75288]: DEBUG os_brick.utils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dc3bc3-4305-465e-8332-fd80a704a1c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42b923b-30bd-41ed-9bd9-d088739b7a63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dae36af-8047-49e7-932c-461e438f8511]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf9d089-332b-4845-b568-65a6ebbda025]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:50:02 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:50:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6122f168-6f5b-4e07-b984-40d09f9c4a57]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG os_brick.utils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:02 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Updating existing volume attachment record: 0ddfa5c8-f040-4511-937b-fd40f103e9b0 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:50:03 user nova-compute[75288]: INFO nova.compute.claims [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Claim successful on node user
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lazy-loading 'flavor' on Instance uuid 2cc53f02-69ec-4302-b972-8fad7ad0e831 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'flavor' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fc4c8d0b-cf98-40e1-9a5f-f581312b2587 tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.577s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:04 user nova-compute[75288]: INFO nova.compute.manager [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Attaching volume d2e1c303-61dc-4e35-b66f-b91b602c2a75 to /dev/vdb
Dec 01 13:50:04 user nova-compute[75288]: DEBUG os_brick.utils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[88725342-b68c-4374-a758-9825ac86a356]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dc5364-4e7d-48ee-a8e7-9a4fdbd04aac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b3d9d-202c-429b-9fac-f6fd4513dedd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bc3d5c-e06d-4918-90e9-d221a58d25c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:50:04 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41d2201-dad8-4f6f-be49-85fd4799ce39]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG os_brick.utils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Updating existing volume attachment record: 0177f5c4-9ff1-460f-83c8-c0c55280ea41 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:50:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.policy [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a771f5164ca349fd9c3ffcc0f0961442', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4860422c7dcb48289f15161dacb1e9d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:50:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Creating image(s)
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "/opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "/opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "/opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk 1073741824" returned: 0 in 0.053s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.240s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Successfully created port: 6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Cannot resize image /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Ensure instance console log exists: /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Successfully updated port: 6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquired lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-8589172a-9989-485d-ad63-87061a209e98 req-e928f88a-29a0-448b-97bb-2c511bb73225 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received event network-changed-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-8589172a-9989-485d-ad63-87061a209e98 req-e928f88a-29a0-448b-97bb-2c511bb73225 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Refreshing instance network info cache due to event network-changed-6d8af2ea-8107-40d1-9f46-2610d8e3e026. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8589172a-9989-485d-ad63-87061a209e98 req-e928f88a-29a0-448b-97bb-2c511bb73225 service nova] Acquiring lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updating instance_info_cache with network_info: [{"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Releasing lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Instance network_info: |[{"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8589172a-9989-485d-ad63-87061a209e98 req-e928f88a-29a0-448b-97bb-2c511bb73225 service nova] Acquired lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-8589172a-9989-485d-ad63-87061a209e98 req-e928f88a-29a0-448b-97bb-2c511bb73225 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Refreshing network info cache for port 6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Start _get_guest_xml network_info=[{"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:50:06 user nova-compute[75288]: WARNING nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 03de2627-2167-48c9-94cb-bd57c18f87c8 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 876c78f2-a975-49ea-9f97-cdca86cc1c51 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid d000b879-6b79-4f80-a69d-548d8108c1ae {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 2cc53f02-69ec-4302-b972-8fad7ad0e831 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 3448c364-2dab-4110-a59f-cc973f73845c {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid e6194101-1671-4beb-bc96-ed503be7fb72 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 64e25352-1ed2-4eda-a376-cb722f0b779f {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "57c16213-db78-4d88-8171-260254bc943a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "3448c364-2dab-4110-a59f-cc973f73845c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "3448c364-2dab-4110-a59f-cc973f73845c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "e6194101-1671-4beb-bc96-ed503be7fb72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "e6194101-1671-4beb-bc96-ed503be7fb72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:06 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:50:06 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1172254663',display_name='tempest-TestServerVolumeAttachmentScenario-server-1172254663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1172254663',id=23,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9t/426wiARJAv1GIUQ8pGEbfWmBRRjHo5E8D3wSC21i47JBBRfs6K6Hwd9aAZjrCCf8nLYQuLnn71JTC7X1YKKIuHuibd3/fA8iPmBrSGVzzIwOlU8ZDPgjCKohLnVZQ==',key_name='tempest-keypair-2025891063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4860422c7dcb48289f15161dacb1e9d5',ramdisk_id='',reservation_id='r-awrzrybj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-175544438',owner_user_name='tempest-TestServerVolumeAttachmentScenario-175544438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a771f5164ca349fd9c3ffcc0f0961442',uuid=a429ddc9-a5d9-460a-aac1-e7a27d7861ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Converting VIF {"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:fd:79,bridge_name='br-int',has_traffic_filtering=True,id=6d8af2ea-8107-40d1-9f46-2610d8e3e026,network=Network(02b307db-737c-434d-97d6-84d3872d535b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8af2ea-81') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lazy-loading 'pci_devices' on Instance uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "57c16213-db78-4d88-8171-260254bc943a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "3448c364-2dab-4110-a59f-cc973f73845c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "e6194101-1671-4beb-bc96-ed503be7fb72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:50:06 user nova-compute[75288]:   <uuid>a429ddc9-a5d9-460a-aac1-e7a27d7861ae</uuid>
Dec 01 13:50:06 user nova-compute[75288]:   <name>instance-00000017</name>
Dec 01 13:50:06 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:50:06 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:50:06 user nova-compute[75288]:   <metadata>
Dec 01 13:50:06 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:50:06 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:50:06 user nova-compute[75288]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1172254663</nova:name>
Dec 01 13:50:06 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:50:06</nova:creationTime>
Dec 01 13:50:06 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:50:06 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:50:06 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:50:06 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:50:06 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:50:06 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:50:06 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:50:06 user nova-compute[75288]:       <nova:owner>
Dec 01 13:50:06 user nova-compute[75288]:         <nova:user uuid="a771f5164ca349fd9c3ffcc0f0961442">tempest-TestServerVolumeAttachmentScenario-175544438-project-member</nova:user>
Dec 01 13:50:06 user nova-compute[75288]:         <nova:project uuid="4860422c7dcb48289f15161dacb1e9d5">tempest-TestServerVolumeAttachmentScenario-175544438</nova:project>
Dec 01 13:50:06 user nova-compute[75288]:       </nova:owner>
Dec 01 13:50:06 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:50:06 user nova-compute[75288]:       <nova:ports>
Dec 01 13:50:06 user nova-compute[75288]:         <nova:port uuid="6d8af2ea-8107-40d1-9f46-2610d8e3e026">
Dec 01 13:50:06 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:50:06 user nova-compute[75288]:         </nova:port>
Dec 01 13:50:06 user nova-compute[75288]:       </nova:ports>
Dec 01 13:50:06 user nova-compute[75288]:     </nova:instance>
Dec 01 13:50:06 user nova-compute[75288]:   </metadata>
Dec 01 13:50:06 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:50:06 user nova-compute[75288]:     <system>
Dec 01 13:50:06 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:50:06 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:50:06 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:50:06 user nova-compute[75288]:       <entry name="serial">a429ddc9-a5d9-460a-aac1-e7a27d7861ae</entry>
Dec 01 13:50:06 user nova-compute[75288]:       <entry name="uuid">a429ddc9-a5d9-460a-aac1-e7a27d7861ae</entry>
Dec 01 13:50:06 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:50:06 user nova-compute[75288]:     </system>
Dec 01 13:50:06 user nova-compute[75288]:   </sysinfo>
Dec 01 13:50:06 user nova-compute[75288]:   <os>
Dec 01 13:50:06 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:50:06 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:50:06 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:50:06 user nova-compute[75288]:   </os>
Dec 01 13:50:06 user nova-compute[75288]:   <features>
Dec 01 13:50:06 user nova-compute[75288]:     <acpi/>
Dec 01 13:50:06 user nova-compute[75288]:     <apic/>
Dec 01 13:50:06 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:50:06 user nova-compute[75288]:   </features>
Dec 01 13:50:06 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:50:06 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:50:06 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:50:06 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:50:06 user nova-compute[75288]:   </clock>
Dec 01 13:50:06 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:50:06 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:50:06 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:50:06 user nova-compute[75288]:   </cpu>
Dec 01 13:50:06 user nova-compute[75288]:   <devices>
Dec 01 13:50:06 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:50:06 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:50:06 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk"/>
Dec 01 13:50:06 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:50:06 user nova-compute[75288]:     </disk>
Dec 01 13:50:06 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:50:06 user nova-compute[75288]:       <mac address="fa:16:3e:81:fd:79"/>
Dec 01 13:50:06 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:50:06 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:50:06 user nova-compute[75288]:       <target dev="tap6d8af2ea-81"/>
Dec 01 13:50:06 user nova-compute[75288]:     </interface>
Dec 01 13:50:06 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:50:06 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/console.log" append="off"/>
Dec 01 13:50:06 user nova-compute[75288]:     </serial>
Dec 01 13:50:06 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:50:06 user nova-compute[75288]:     <video>
Dec 01 13:50:06 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:50:06 user nova-compute[75288]:     </video>
Dec 01 13:50:06 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:50:06 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:50:06 user nova-compute[75288]:     </rng>
Dec 01 13:50:06 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:50:06 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:50:06 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:50:06 user nova-compute[75288]:     </memballoon>
Dec 01 13:50:06 user nova-compute[75288]:   </devices>
Dec 01 13:50:06 user nova-compute[75288]: </domain>
Dec 01 13:50:06 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1172254663',display_name='tempest-TestServerVolumeAttachmentScenario-server-1172254663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1172254663',id=23,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9t/426wiARJAv1GIUQ8pGEbfWmBRRjHo5E8D3wSC21i47JBBRfs6K6Hwd9aAZjrCCf8nLYQuLnn71JTC7X1YKKIuHuibd3/fA8iPmBrSGVzzIwOlU8ZDPgjCKohLnVZQ==',key_name='tempest-keypair-2025891063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4860422c7dcb48289f15161dacb1e9d5',ramdisk_id='',reservation_id='r-awrzrybj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-175544438',owner_user_name='tempest-TestServerVolumeAttachmentScenario-175544438-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a771f5164ca349fd9c3ffcc0f0961442',uuid=a429ddc9-a5d9-460a-aac1-e7a27d7861ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Converting VIF {"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:fd:79,bridge_name='br-int',has_traffic_filtering=True,id=6d8af2ea-8107-40d1-9f46-2610d8e3e026,network=Network(02b307db-737c-434d-97d6-84d3872d535b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8af2ea-81') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG os_vif [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:fd:79,bridge_name='br-int',has_traffic_filtering=True,id=6d8af2ea-8107-40d1-9f46-2610d8e3e026,network=Network(02b307db-737c-434d-97d6-84d3872d535b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8af2ea-81') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '835f2ace-603f-5440-a4bd-31ee932bfeeb', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d8af2ea-81, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d8af2ea-81, col_values=(('qos', UUID('eb2d1ac1-9fce-477f-83e5-c0b0bb9b9078')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d8af2ea-81, col_values=(('external_ids', {'iface-id': '6d8af2ea-8107-40d1-9f46-2610d8e3e026', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:fd:79', 'vm-uuid': 'a429ddc9-a5d9-460a-aac1-e7a27d7861ae'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:06 user nova-compute[75288]: INFO os_vif [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:fd:79,bridge_name='br-int',has_traffic_filtering=True,id=6d8af2ea-8107-40d1-9f46-2610d8e3e026,network=Network(02b307db-737c-434d-97d6-84d3872d535b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8af2ea-81')
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No VIF found with MAC fa:16:3e:81:fd:79, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-8589172a-9989-485d-ad63-87061a209e98 req-e928f88a-29a0-448b-97bb-2c511bb73225 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updated VIF entry in instance network info cache for port 6d8af2ea-8107-40d1-9f46-2610d8e3e026. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:50:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-8589172a-9989-485d-ad63-87061a209e98 req-e928f88a-29a0-448b-97bb-2c511bb73225 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updating instance_info_cache with network_info: [{"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8589172a-9989-485d-ad63-87061a209e98 req-e928f88a-29a0-448b-97bb-2c511bb73225 service nova] Releasing lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:07 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:50:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-5e30d228-df6b-4ad9-baa1-41bd7f395c46 req-464f06d5-5f7c-4c3f-a665-391cc5b6bb36 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received event network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5e30d228-df6b-4ad9-baa1-41bd7f395c46 req-464f06d5-5f7c-4c3f-a665-391cc5b6bb36 service nova] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5e30d228-df6b-4ad9-baa1-41bd7f395c46 req-464f06d5-5f7c-4c3f-a665-391cc5b6bb36 service nova] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5e30d228-df6b-4ad9-baa1-41bd7f395c46 req-464f06d5-5f7c-4c3f-a665-391cc5b6bb36 service nova] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-5e30d228-df6b-4ad9-baa1-41bd7f395c46 req-464f06d5-5f7c-4c3f-a665-391cc5b6bb36 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] No waiting events found dispatching network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:08 user nova-compute[75288]: WARNING nova.compute.manager [req-5e30d228-df6b-4ad9-baa1-41bd7f395c46 req-464f06d5-5f7c-4c3f-a665-391cc5b6bb36 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received unexpected event network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 for instance with vm_state building and task_state spawning.
Dec 01 13:50:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:50:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Instance spawned successfully.
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:10 user nova-compute[75288]: INFO nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Took 6.12 seconds to spawn the instance on the hypervisor.
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-7ab103a7-80da-4705-bc7a-e8532d5637c1 req-d4210f42-438e-4429-9544-43613722967b service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received event network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7ab103a7-80da-4705-bc7a-e8532d5637c1 req-d4210f42-438e-4429-9544-43613722967b service nova] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7ab103a7-80da-4705-bc7a-e8532d5637c1 req-d4210f42-438e-4429-9544-43613722967b service nova] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7ab103a7-80da-4705-bc7a-e8532d5637c1 req-d4210f42-438e-4429-9544-43613722967b service nova] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-7ab103a7-80da-4705-bc7a-e8532d5637c1 req-d4210f42-438e-4429-9544-43613722967b service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] No waiting events found dispatching network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:10 user nova-compute[75288]: WARNING nova.compute.manager [req-7ab103a7-80da-4705-bc7a-e8532d5637c1 req-d4210f42-438e-4429-9544-43613722967b service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received unexpected event network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 for instance with vm_state building and task_state spawning.
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:10 user nova-compute[75288]: INFO nova.compute.manager [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Took 7.19 seconds to build instance.
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5dfbae2d-7113-431a-a1e2-41b759c466d2 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.315s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.296s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:10 user nova-compute[75288]: INFO nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] During sync_power_state the instance has a pending task (spawning). Skip.
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljbcCzho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:12 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:50:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:50:12 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:50:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:50:12 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5775e40-1bec-42ec-b4be-760bb151ceac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:50:12 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f583a9-7e45-4f5e-8c2c-90eac4cad779]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17] added
Dec 01 13:50:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bb98b9-f1c8-4bca-aca1-b875480fda4b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86755869-d022-4b4c-ac59-7cf392c81702]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljbcCzho {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljbcCzho" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c9d96e-951a-41d6-b5b7-a0600baa49a2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ljbcCzho'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b390f0-889e-43e4-868f-db5a8b62982c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6963f9c1-5e73-47dd-afa7-108a3aa43111]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[85720e08-e945-4f17-a96b-ccb9c9b85a5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17, portal: 172.16.0.220,3260]
Dec 01 13:50:13 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17, portal: 172.16.0.220,3260] successful.
Dec 01 13:50:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c59418-a0e9-46e3-926a-aa3762783cda]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a9152-510f-4059-b466-30d9344390f2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[db826629-50d4-4a88-84e0-f8f7c1a5f92b]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljbcCzho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23334366132306631', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334366132306631', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lazy-loading 'flavor' on Instance uuid d000b879-6b79-4f80-a69d-548d8108c1ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:50:14 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:50:14 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:50:14 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:50:14 user nova-compute[75288]:   <serial>5f390977-0aeb-4c8d-97ab-def02c3a2b17</serial>
Dec 01 13:50:14 user nova-compute[75288]: </disk>
Dec 01 13:50:14 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] No VIF found with MAC fa:16:3e:c6:93:91, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6142a0c0-38a0-4643-8fb4-b7e617e7ef86 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.351s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.474s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtRuXOnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:50:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:50:16 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:50:16 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=6905MB free_disk=25.177021026611328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ae08fc-5556-4864-a763-4e53b14cfb73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:50:16 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b515b6-3338-4a69-9fc2-aa6f057db0c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75] added
Dec 01 13:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[95234f6f-48fc-49e9-9c96-f65604d92529]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3956a109-d3c8-4c7f-81a5-1923b6a612da]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtRuXOnF {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtRuXOnF" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2d508-2fc0-475d-b256-17b4e1345f1f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rtRuXOnF'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[164d16b7-89b9-43b2-a4ae-63d6196956dd]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 64e25352-1ed2-4eda-a376-cb722f0b779f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d000b879-6b79-4f80-a69d-548d8108c1ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 2cc53f02-69ec-4302-b972-8fad7ad0e831 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 3448c364-2dab-4110-a59f-cc973f73845c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b6118993-49ad-4e01-8b70-e79eaf510b59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e6194101-1671-4beb-bc96-ed503be7fb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf8367-cbcb-4887-8e48-f9a411406ed6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e2b6ed-8d24-450a-9b03-a1697f14a3bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75, portal: 172.16.0.220,3260]
Dec 01 13:50:16 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75, portal: 172.16.0.220,3260] successful.
Dec 01 13:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a0ca75-3e87-4eb9-b2f6-bcda6558501e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d3f963-5c7b-4476-ab49-9cfdb3ba613f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 (non-flash)
Dec 01 13:50:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ce2ea-69fe-4ea5-a427-d99808e976ca]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:50:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:17 user nova-compute[75288]: INFO nova.compute.manager [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Detaching volume 5f390977-0aeb-4c8d-97ab-def02c3a2b17
Dec 01 13:50:17 user nova-compute[75288]: INFO nova.virt.block_device [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Attempting to driver detach volume 5f390977-0aeb-4c8d-97ab-def02c3a2b17 from mountpoint /dev/vdb
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Attempting to detach device vdb from instance d000b879-6b79-4f80-a69d-548d8108c1ae from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:50:17 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:50:17 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:50:17 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:50:17 user nova-compute[75288]:   <serial>5f390977-0aeb-4c8d-97ab-def02c3a2b17</serial>
Dec 01 13:50:17 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:50:17 user nova-compute[75288]: </disk>
Dec 01 13:50:17 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:50:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Successfully detached device vdb from instance d000b879-6b79-4f80-a69d-548d8108c1ae from the persistent domain config.
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d000b879-6b79-4f80-a69d-548d8108c1ae from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:50:17 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:50:17 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:50:17 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:50:17 user nova-compute[75288]:   <serial>5f390977-0aeb-4c8d-97ab-def02c3a2b17</serial>
Dec 01 13:50:17 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:50:17 user nova-compute[75288]: </disk>
Dec 01 13:50:17 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtRuXOnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26565393063653762', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565393063653762', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lazy-loading 'flavor' on Instance uuid 2cc53f02-69ec-4302-b972-8fad7ad0e831 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:50:17 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:50:17 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:50:17 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:50:17 user nova-compute[75288]:   <serial>d2e1c303-61dc-4e35-b66f-b91b602c2a75</serial>
Dec 01 13:50:17 user nova-compute[75288]: </disk>
Dec 01 13:50:17 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d000b879-6b79-4f80-a69d-548d8108c1ae {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:50:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] No VIF found with MAC fa:16:3e:a4:55:22, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b4c78410-dc69-42f7-878a-4a6202acf466 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.126s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.547s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:18 user nova-compute[75288]: INFO nova.compute.manager [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Terminating instance
Dec 01 13:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-1e97c929-6782-4686-b499-841a27bb3def req-fb45e30c-bc0d-4d61-a985-5bb08aa2b297 service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received event network-vif-unplugged-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1e97c929-6782-4686-b499-841a27bb3def req-fb45e30c-bc0d-4d61-a985-5bb08aa2b297 service nova] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1e97c929-6782-4686-b499-841a27bb3def req-fb45e30c-bc0d-4d61-a985-5bb08aa2b297 service nova] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1e97c929-6782-4686-b499-841a27bb3def req-fb45e30c-bc0d-4d61-a985-5bb08aa2b297 service nova] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-1e97c929-6782-4686-b499-841a27bb3def req-fb45e30c-bc0d-4d61-a985-5bb08aa2b297 service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] No waiting events found dispatching network-vif-unplugged-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-1e97c929-6782-4686-b499-841a27bb3def req-fb45e30c-bc0d-4d61-a985-5bb08aa2b297 service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received event network-vif-unplugged-33db5216-2d25-42b7-a17b-e9e1bcd306af for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:50:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Instance destroyed successfully.
Dec 01 13:50:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lazy-loading 'resources' on Instance uuid 2cc53f02-69ec-4302-b972-8fad7ad0e831 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-515720010',display_name='tempest-DeleteServersTestJSON-server-515720010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-515720010',id=19,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:48:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='157c210a93ab4db79ea369e26c462244',ramdisk_id='',reservation_id='r-dhpy48r0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-891849180',owner_user_name='tempest-DeleteServersTestJSON-891849180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:48:18Z,user_data=None,user_id='4d66b204f52341d7bc7548ab1db31fcc',uuid=2cc53f02-69ec-4302-b972-8fad7ad0e831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Converting VIF {"id": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "address": "fa:16:3e:a4:55:22", "network": {"id": "0ff01792-285b-45b5-994f-769dc8313257", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-840906202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "157c210a93ab4db79ea369e26c462244", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33db5216-2d", "ovs_interfaceid": "33db5216-2d25-42b7-a17b-e9e1bcd306af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=33db5216-2d25-42b7-a17b-e9e1bcd306af,network=Network(0ff01792-285b-45b5-994f-769dc8313257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33db5216-2d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_vif [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=33db5216-2d25-42b7-a17b-e9e1bcd306af,network=Network(0ff01792-285b-45b5-994f-769dc8313257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33db5216-2d') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33db5216-2d, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a715e653-fdc3-412b-a07d-c5e971dac426) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:19 user nova-compute[75288]: INFO os_vif [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:55:22,bridge_name='br-int',has_traffic_filtering=True,id=33db5216-2d25-42b7-a17b-e9e1bcd306af,network=Network(0ff01792-285b-45b5-994f-769dc8313257),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33db5216-2d')
Dec 01 13:50:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtRuXOnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a0c680-43be-40c7-998c-4028c288ab14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:50:19 user nova-compute[75288]: No targets found.
Dec 01 13:50:19 user nova-compute[75288]: iSNS:
Dec 01 13:50:19 user nova-compute[75288]: No targets found.
Dec 01 13:50:19 user nova-compute[75288]: STATIC:
Dec 01 13:50:19 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17
Dec 01 13:50:19 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:19 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:19 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75
Dec 01 13:50:19 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:19 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:19 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:50:19 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:19 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:19 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:50:19 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:19 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:19 user nova-compute[75288]: FIRMWARE:
Dec 01 13:50:19 user nova-compute[75288]: No targets found.
Dec 01 13:50:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:50:19 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:50:19 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[287871b5-a41d-4660-b08b-67dd477c3450]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f779ca-678d-4db9-9190-1447802edb92]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:19 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:19 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:19 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 (non-flash)
Dec 01 13:50:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:19 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:19 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:19 user nova-compute[75288]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 (non-flash)
Dec 01 13:50:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ea9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d05e1-fbf2-4b91-99f1-bbb66858c51e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[56696a03-ccf9-4862-a98a-7722b5e43d5e]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac54a13d-b8a0-4695-9d3f-41dc4152a16f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5baa7d-4feb-4766-97c9-cf30ec7d363f]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15b2fe3-4dd7-4d43-bd5b-b3eb7ae83e62]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e03e79-c20f-4cdf-b4f0-4cd7b31a7a4e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75, portal: 172.16.0.220,3260]
Dec 01 13:50:19 user nova-compute[75288]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75, portal: 172.16.0.220,3260] successful.
Dec 01 13:50:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2e1c303-61dc-4e35-b66f-b91b602c2a75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada1bcea-2ba4-4bf5-bd7f-9270a7f19d15]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] <== disconnect_volume: return (303ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:50:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Deleting instance files /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831_del
Dec 01 13:50:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Deletion of /opt/stack/data/nova/instances/2cc53f02-69ec-4302-b972-8fad7ad0e831_del complete
Dec 01 13:50:19 user nova-compute[75288]: INFO nova.compute.manager [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 01 13:50:19 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:50:19 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:50:20 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:20 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Took 0.46 seconds to deallocate network for instance.
Dec 01 13:50:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-f15cd661-6757-471a-a716-507a76403c6d req-724ff51f-38c9-492d-9839-fe572184084b service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received event network-vif-deleted-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-92c007cd-9c41-4c1f-af32-430946df962a req-8cfb198e-502e-4013-b55d-2922379e2810 service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received event network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92c007cd-9c41-4c1f-af32-430946df962a req-8cfb198e-502e-4013-b55d-2922379e2810 service nova] Acquiring lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92c007cd-9c41-4c1f-af32-430946df962a req-8cfb198e-502e-4013-b55d-2922379e2810 service nova] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92c007cd-9c41-4c1f-af32-430946df962a req-8cfb198e-502e-4013-b55d-2922379e2810 service nova] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-92c007cd-9c41-4c1f-af32-430946df962a req-8cfb198e-502e-4013-b55d-2922379e2810 service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] No waiting events found dispatching network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:20 user nova-compute[75288]: WARNING nova.compute.manager [req-92c007cd-9c41-4c1f-af32-430946df962a req-8cfb198e-502e-4013-b55d-2922379e2810 service nova] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Received unexpected event network-vif-plugged-33db5216-2d25-42b7-a17b-e9e1bcd306af for instance with vm_state active and task_state deleting.
Dec 01 13:50:21 user nova-compute[75288]: INFO nova.compute.manager [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] [instance: 2cc53f02-69ec-4302-b972-8fad7ad0e831] Took 1.43 seconds to detach 1 volumes for instance.
Dec 01 13:50:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:50:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:50:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:21 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Deleted allocations for instance 2cc53f02-69ec-4302-b972-8fad7ad0e831
Dec 01 13:50:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e880ec1-66c1-437e-b9a6-56c5cd752c57 tempest-DeleteServersTestJSON-891849180 tempest-DeleteServersTestJSON-891849180-project-member] Lock "2cc53f02-69ec-4302-b972-8fad7ad0e831" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.613s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:30 user nova-compute[75288]: INFO nova.compute.manager [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Terminating instance
Dec 01 13:50:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8644c35-a1c4-41a6-9735-fd9821b10b2b req-a08a33d3-e1a1-4964-97fe-f310843ff883 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8644c35-a1c4-41a6-9735-fd9821b10b2b req-a08a33d3-e1a1-4964-97fe-f310843ff883 service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8644c35-a1c4-41a6-9735-fd9821b10b2b req-a08a33d3-e1a1-4964-97fe-f310843ff883 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e8644c35-a1c4-41a6-9735-fd9821b10b2b req-a08a33d3-e1a1-4964-97fe-f310843ff883 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8644c35-a1c4-41a6-9735-fd9821b10b2b req-a08a33d3-e1a1-4964-97fe-f310843ff883 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-e8644c35-a1c4-41a6-9735-fd9821b10b2b req-a08a33d3-e1a1-4964-97fe-f310843ff883 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-unplugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Instance destroyed successfully.
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lazy-loading 'resources' on Instance uuid f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1274625653',display_name='tempest-ServerStableDeviceRescueTest-server-1274625653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1274625653',id=4,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfA+ZDO7xALSyEhCRvYLfQ+xYp3su3wJdrLeQt71rSzduiAJ0Kj9QHOIOMdGWpjCmn0eSrw/Ozpvfaqj/WbpdwfUSNZlYZrAJSO6YTtD/s2q0XiPWvAb1X5yuNUVqfqiQ==',key_name='tempest-keypair-1837351537',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:47:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8816f73a6346a9a973142c4af6d381',ramdisk_id='',reservation_id='r-zsc9kejp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-918439040',owner_user_name='tempest-ServerStableDeviceRescueTest-918439040-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f0219ef4ab742cdb27296abc211a120',uuid=f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Converting VIF {"id": "e41a567f-0fb6-4089-b693-d8d527576a17", "address": "fa:16:3e:eb:4d:a9", "network": {"id": "98055b13-feb2-4087-a8ea-124ab71ba571", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1023707169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8816f73a6346a9a973142c4af6d381", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape41a567f-0f", "ovs_interfaceid": "e41a567f-0fb6-4089-b693-d8d527576a17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:4d:a9,bridge_name='br-int',has_traffic_filtering=True,id=e41a567f-0fb6-4089-b693-d8d527576a17,network=Network(98055b13-feb2-4087-a8ea-124ab71ba571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41a567f-0f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG os_vif [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:4d:a9,bridge_name='br-int',has_traffic_filtering=True,id=e41a567f-0fb6-4089-b693-d8d527576a17,network=Network(98055b13-feb2-4087-a8ea-124ab71ba571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41a567f-0f') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape41a567f-0f, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6637bc1-adf9-45b5-9c2d-931f8a1a17ca) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:31 user nova-compute[75288]: INFO os_vif [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:4d:a9,bridge_name='br-int',has_traffic_filtering=True,id=e41a567f-0fb6-4089-b693-d8d527576a17,network=Network(98055b13-feb2-4087-a8ea-124ab71ba571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape41a567f-0f')
Dec 01 13:50:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Deleting instance files /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af_del
Dec 01 13:50:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Deletion of /opt/stack/data/nova/instances/f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af_del complete
Dec 01 13:50:31 user nova-compute[75288]: INFO nova.compute.manager [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 01 13:50:31 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:50:31 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:50:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:32 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:32 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Took 0.79 seconds to deallocate network for instance.
Dec 01 13:50:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-df6fbea9-c0e6-48ef-8d63-b6597cc4423c req-e33ca4ec-bc48-41bc-827b-bacaf832ffaf service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-deleted-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:32 user nova-compute[75288]: INFO nova.compute.manager [req-df6fbea9-c0e6-48ef-8d63-b6597cc4423c req-e33ca4ec-bc48-41bc-827b-bacaf832ffaf service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Neutron deleted interface e41a567f-0fb6-4089-b693-d8d527576a17; detaching it from the instance and deleting it from the info cache
Dec 01 13:50:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-df6fbea9-c0e6-48ef-8d63-b6597cc4423c req-e33ca4ec-bc48-41bc-827b-bacaf832ffaf service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-df6fbea9-c0e6-48ef-8d63-b6597cc4423c req-e33ca4ec-bc48-41bc-827b-bacaf832ffaf service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Detach interface failed, port_id=e41a567f-0fb6-4089-b693-d8d527576a17, reason: Instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:50:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:33 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:50:33 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:50:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:33 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Deleted allocations for instance f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af
Dec 01 13:50:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5d9c0eed-21b1-45a9-8e25-be641b6cbb2b tempest-ServerStableDeviceRescueTest-918439040 tempest-ServerStableDeviceRescueTest-918439040-project-member] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.248s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-bb408191-1c19-4bb3-adf4-500c510b1c99 req-ce1e244e-24d6-44e9-a823-39553c82ae25 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bb408191-1c19-4bb3-adf4-500c510b1c99 req-ce1e244e-24d6-44e9-a823-39553c82ae25 service nova] Acquiring lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bb408191-1c19-4bb3-adf4-500c510b1c99 req-ce1e244e-24d6-44e9-a823-39553c82ae25 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bb408191-1c19-4bb3-adf4-500c510b1c99 req-ce1e244e-24d6-44e9-a823-39553c82ae25 service nova] Lock "f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-bb408191-1c19-4bb3-adf4-500c510b1c99 req-ce1e244e-24d6-44e9-a823-39553c82ae25 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] No waiting events found dispatching network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:33 user nova-compute[75288]: WARNING nova.compute.manager [req-bb408191-1c19-4bb3-adf4-500c510b1c99 req-ce1e244e-24d6-44e9-a823-39553c82ae25 service nova] [instance: f5fbd2f3-ae6b-4a9b-b75c-df984e5a69af] Received unexpected event network-vif-plugged-e41a567f-0fb6-4089-b693-d8d527576a17 for instance with vm_state deleted and task_state None.
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-92e74852-1cd2-45b4-81fe-e004360195e9 req-77223098-5149-4219-8f7a-ff15fa7d0aba service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received event network-changed-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-92e74852-1cd2-45b4-81fe-e004360195e9 req-77223098-5149-4219-8f7a-ff15fa7d0aba service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Refreshing instance network info cache due to event network-changed-83cab345-de3c-455d-9b6a-9708a59fc91e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92e74852-1cd2-45b4-81fe-e004360195e9 req-77223098-5149-4219-8f7a-ff15fa7d0aba service nova] Acquiring lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92e74852-1cd2-45b4-81fe-e004360195e9 req-77223098-5149-4219-8f7a-ff15fa7d0aba service nova] Acquired lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-92e74852-1cd2-45b4-81fe-e004360195e9 req-77223098-5149-4219-8f7a-ff15fa7d0aba service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Refreshing network info cache for port 83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "3448c364-2dab-4110-a59f-cc973f73845c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "3448c364-2dab-4110-a59f-cc973f73845c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "3448c364-2dab-4110-a59f-cc973f73845c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:35 user nova-compute[75288]: INFO nova.compute.manager [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Terminating instance
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-92e74852-1cd2-45b4-81fe-e004360195e9 req-77223098-5149-4219-8f7a-ff15fa7d0aba service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Updated VIF entry in instance network info cache for port 83cab345-de3c-455d-9b6a-9708a59fc91e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-92e74852-1cd2-45b4-81fe-e004360195e9 req-77223098-5149-4219-8f7a-ff15fa7d0aba service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Updating instance_info_cache with network_info: [{"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-fc28b5a6-8284-45e4-8f9f-47023fe97c19 req-6aae0da2-f175-4af9-b83c-5d0e95b339c7 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received event network-vif-unplugged-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc28b5a6-8284-45e4-8f9f-47023fe97c19 req-6aae0da2-f175-4af9-b83c-5d0e95b339c7 service nova] Acquiring lock "3448c364-2dab-4110-a59f-cc973f73845c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc28b5a6-8284-45e4-8f9f-47023fe97c19 req-6aae0da2-f175-4af9-b83c-5d0e95b339c7 service nova] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fc28b5a6-8284-45e4-8f9f-47023fe97c19 req-6aae0da2-f175-4af9-b83c-5d0e95b339c7 service nova] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-fc28b5a6-8284-45e4-8f9f-47023fe97c19 req-6aae0da2-f175-4af9-b83c-5d0e95b339c7 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] No waiting events found dispatching network-vif-unplugged-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-fc28b5a6-8284-45e4-8f9f-47023fe97c19 req-6aae0da2-f175-4af9-b83c-5d0e95b339c7 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received event network-vif-unplugged-83cab345-de3c-455d-9b6a-9708a59fc91e for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:50:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92e74852-1cd2-45b4-81fe-e004360195e9 req-77223098-5149-4219-8f7a-ff15fa7d0aba service nova] Releasing lock "refresh_cache-3448c364-2dab-4110-a59f-cc973f73845c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Instance destroyed successfully.
Dec 01 13:50:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lazy-loading 'resources' on Instance uuid 3448c364-2dab-4110-a59f-cc973f73845c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-558391406',display_name='tempest-TestVolumeBootPattern-server-558391406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-558391406',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-g663vi2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:02Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=3448c364-2dab-4110-a59f-cc973f73845c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "83cab345-de3c-455d-9b6a-9708a59fc91e", "address": "fa:16:3e:55:8b:24", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83cab345-de", "ovs_interfaceid": "83cab345-de3c-455d-9b6a-9708a59fc91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:8b:24,bridge_name='br-int',has_traffic_filtering=True,id=83cab345-de3c-455d-9b6a-9708a59fc91e,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cab345-de') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_vif [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:8b:24,bridge_name='br-int',has_traffic_filtering=True,id=83cab345-de3c-455d-9b6a-9708a59fc91e,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cab345-de') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83cab345-de, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2821f46a-4dd1-45e1-a8ea-ccd4e500e5b7) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:36 user nova-compute[75288]: INFO os_vif [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:8b:24,bridge_name='br-int',has_traffic_filtering=True,id=83cab345-de3c-455d-9b6a-9708a59fc91e,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83cab345-de')
Dec 01 13:50:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KraZUmid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:36 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4480f3b-fa2b-4fc7-abd2-00785201113a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:50:36 user nova-compute[75288]: No targets found.
Dec 01 13:50:36 user nova-compute[75288]: iSNS:
Dec 01 13:50:36 user nova-compute[75288]: No targets found.
Dec 01 13:50:36 user nova-compute[75288]: STATIC:
Dec 01 13:50:36 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17
Dec 01 13:50:36 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:36 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:36 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:50:36 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:36 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:36 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:50:36 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:36 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:36 user nova-compute[75288]: FIRMWARE:
Dec 01 13:50:36 user nova-compute[75288]: No targets found.
Dec 01 13:50:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:50:36 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:50:36 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[37860b94-c078-413d-bfb5-6febed6f9b84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b1c20a-b80f-4a97-9731-6a3055d304f4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:36 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:36 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:50:36 user nova-compute[75288]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:36 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98dca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c05332-5a48-4429-8fe4-3df6bb67bc0d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e366e07b-aaeb-4491-a470-a63b3c4db0b7]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ba9eb7-32ed-4bcd-b0f9-a8936e222984]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc453b23-21ad-43b5-a09c-facc87775c7a]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c3f850-ad02-4a0d-830e-7579b37e7e0b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f152fae-6062-40d3-addc-2f5badf157f8]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260]
Dec 01 13:50:36 user nova-compute[75288]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260] successful.
Dec 01 13:50:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb73931-6cfe-4d6c-83ca-d2ce1a2a2470]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== disconnect_volume: return (304ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:50:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Deleting instance files /opt/stack/data/nova/instances/3448c364-2dab-4110-a59f-cc973f73845c_del
Dec 01 13:50:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Deletion of /opt/stack/data/nova/instances/3448c364-2dab-4110-a59f-cc973f73845c_del complete
Dec 01 13:50:36 user nova-compute[75288]: INFO nova.compute.manager [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 01 13:50:36 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:50:36 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d000b879-6b79-4f80-a69d-548d8108c1ae is timed out.
Dec 01 13:50:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Successfully detached device vdb from instance d000b879-6b79-4f80-a69d-548d8108c1ae from the live domain config.
Dec 01 13:50:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljbcCzho', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:37 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11cc826-d2db-4fb7-a585-35953f23ec53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:50:37 user nova-compute[75288]: No targets found.
Dec 01 13:50:37 user nova-compute[75288]: iSNS:
Dec 01 13:50:37 user nova-compute[75288]: No targets found.
Dec 01 13:50:37 user nova-compute[75288]: STATIC:
Dec 01 13:50:37 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17
Dec 01 13:50:37 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:37 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:37 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:50:37 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:50:37 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:50:37 user nova-compute[75288]: FIRMWARE:
Dec 01 13:50:37 user nova-compute[75288]: No targets found.
Dec 01 13:50:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:50:37 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:50:37 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba13679e-ce28-4edb-b50f-e8ca1944cef0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Took 0.81 seconds to deallocate network for instance.
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42b74cf-726f-4553-9c13-e6bdd7b8f82d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:37 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:50:37 user nova-compute[75288]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 (non-flash)
Dec 01 13:50:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ed12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-085e4499-c39d-4d02-87ed-348ec35ae4d9 req-b54ece31-4667-48cc-9453-66aa88a0bdd7 service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received event network-vif-deleted-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe52e97-bac5-4cb1-9646-b2ebaaf7f139]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c40f3c-a48e-4ee4-9cb8-4a0da2152543]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[919249e2-f9b0-45dc-8d21-e4ae7e463b44]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[85564f49-ad94-4e80-ba39-90c88c52cab2]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc24322-d189-4642-9ff0-d2782d9e1b54]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a925b73-f466-4caf-8062-c8eda8bcc9c3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17, portal: 172.16.0.220,3260]
Dec 01 13:50:37 user nova-compute[75288]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17, portal: 172.16.0.220,3260] successful.
Dec 01 13:50:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f390977-0aeb-4c8d-97ab-def02c3a2b17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f764e98-1a17-4397-9501-9051c4ed2aff]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] <== disconnect_volume: return (317ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-ff0b2de4-ee33-485f-a94c-4c8921b0b255 req-150070dd-4244-4687-9d3b-88d792ac7d2d service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received event network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff0b2de4-ee33-485f-a94c-4c8921b0b255 req-150070dd-4244-4687-9d3b-88d792ac7d2d service nova] Acquiring lock "3448c364-2dab-4110-a59f-cc973f73845c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff0b2de4-ee33-485f-a94c-4c8921b0b255 req-150070dd-4244-4687-9d3b-88d792ac7d2d service nova] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff0b2de4-ee33-485f-a94c-4c8921b0b255 req-150070dd-4244-4687-9d3b-88d792ac7d2d service nova] Lock "3448c364-2dab-4110-a59f-cc973f73845c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-ff0b2de4-ee33-485f-a94c-4c8921b0b255 req-150070dd-4244-4687-9d3b-88d792ac7d2d service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] No waiting events found dispatching network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:38 user nova-compute[75288]: WARNING nova.compute.manager [req-ff0b2de4-ee33-485f-a94c-4c8921b0b255 req-150070dd-4244-4687-9d3b-88d792ac7d2d service nova] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Received unexpected event network-vif-plugged-83cab345-de3c-455d-9b6a-9708a59fc91e for instance with vm_state active and task_state deleting.
Dec 01 13:50:38 user nova-compute[75288]: INFO nova.compute.manager [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 3448c364-2dab-4110-a59f-cc973f73845c] Took 0.82 seconds to detach 1 volumes for instance.
Dec 01 13:50:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lazy-loading 'flavor' on Instance uuid d000b879-6b79-4f80-a69d-548d8108c1ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3ad4b304-ab38-4e8a-8d06-00f8b85c938c tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.821s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:50:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:50:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:39 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Deleted allocations for instance 3448c364-2dab-4110-a59f-cc973f73845c
Dec 01 13:50:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-04f174cf-f964-4af2-98d3-eb7c0f1c41a1 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "3448c364-2dab-4110-a59f-cc973f73845c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.469s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-18850bdb-8f72-4691-b6dc-65e35be9b985 req-d02e5f5b-2ca6-4773-80e1-53d6875a34e8 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-changed-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-18850bdb-8f72-4691-b6dc-65e35be9b985 req-d02e5f5b-2ca6-4773-80e1-53d6875a34e8 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Refreshing instance network info cache due to event network-changed-149cf680-382c-459a-873b-fb777184f080. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:50:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-18850bdb-8f72-4691-b6dc-65e35be9b985 req-d02e5f5b-2ca6-4773-80e1-53d6875a34e8 service nova] Acquiring lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:50:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-18850bdb-8f72-4691-b6dc-65e35be9b985 req-d02e5f5b-2ca6-4773-80e1-53d6875a34e8 service nova] Acquired lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:50:45 user nova-compute[75288]: DEBUG nova.network.neutron [req-18850bdb-8f72-4691-b6dc-65e35be9b985 req-d02e5f5b-2ca6-4773-80e1-53d6875a34e8 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Refreshing network info cache for port 149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:50:46 user nova-compute[75288]: DEBUG nova.network.neutron [req-18850bdb-8f72-4691-b6dc-65e35be9b985 req-d02e5f5b-2ca6-4773-80e1-53d6875a34e8 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updated VIF entry in instance network info cache for port 149cf680-382c-459a-873b-fb777184f080. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:50:46 user nova-compute[75288]: DEBUG nova.network.neutron [req-18850bdb-8f72-4691-b6dc-65e35be9b985 req-d02e5f5b-2ca6-4773-80e1-53d6875a34e8 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-18850bdb-8f72-4691-b6dc-65e35be9b985 req-d02e5f5b-2ca6-4773-80e1-53d6875a34e8 service nova] Releasing lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "interface-b6118993-49ad-4e01-8b70-e79eaf510b59-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "interface-b6118993-49ad-4e01-8b70-e79eaf510b59-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lazy-loading 'flavor' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lazy-loading 'pci_requests' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Object Instance<b6118993-49ad-4e01-8b70-e79eaf510b59> lazy-loaded attributes: flavor,pci_requests {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:50:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:50:47 user nova-compute[75288]: DEBUG nova.policy [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3da01fd9ed04c2984868b13e38d3983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7111fdc7a44f539b3c53ac5c7b4961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:50:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Successfully created port: b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:50:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Successfully updated port: b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:50:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:50:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquired lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:50:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:50:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f865d1b-b9b0-44df-bb65-10db64f26327 req-5fb9873e-625d-481c-b753-5b832d0484be service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-changed-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f865d1b-b9b0-44df-bb65-10db64f26327 req-5fb9873e-625d-481c-b753-5b832d0484be service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Refreshing instance network info cache due to event network-changed-b3321e01-4a80-47be-b8e3-bcc3dea4b62a. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:50:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f865d1b-b9b0-44df-bb65-10db64f26327 req-5fb9873e-625d-481c-b753-5b832d0484be service nova] Acquiring lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Releasing lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f865d1b-b9b0-44df-bb65-10db64f26327 req-5fb9873e-625d-481c-b753-5b832d0484be service nova] Acquired lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-6f865d1b-b9b0-44df-bb65-10db64f26327 req-5fb9873e-625d-481c-b753-5b832d0484be service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Refreshing network info cache for port b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converting VIF {"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG os_vif [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08215f39-c834-5514-9c15-40e11a71bf2c', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3321e01-4a, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3321e01-4a, col_values=(('qos', UUID('e6073a5a-7763-4605-b87a-ac1656ffa938')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3321e01-4a, col_values=(('external_ids', {'iface-id': 'b3321e01-4a80-47be-b8e3-bcc3dea4b62a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:f3:c7', 'vm-uuid': 'b6118993-49ad-4e01-8b70-e79eaf510b59'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:49 user nova-compute[75288]: INFO os_vif [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a')
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converting VIF {"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] attach device xml: <interface type="ethernet">
Dec 01 13:50:49 user nova-compute[75288]:   <mac address="fa:16:3e:c5:f3:c7"/>
Dec 01 13:50:49 user nova-compute[75288]:   <model type="virtio"/>
Dec 01 13:50:49 user nova-compute[75288]:   <mtu size="1442"/>
Dec 01 13:50:49 user nova-compute[75288]:   <target dev="tapb3321e01-4a"/>
Dec 01 13:50:49 user nova-compute[75288]: </interface>
Dec 01 13:50:49 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-59526444-6752-4a03-8483-2736cf50dfd1 req-bd494643-8a6b-4802-b304-ef71d123e836 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59526444-6752-4a03-8483-2736cf50dfd1 req-bd494643-8a6b-4802-b304-ef71d123e836 service nova] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59526444-6752-4a03-8483-2736cf50dfd1 req-bd494643-8a6b-4802-b304-ef71d123e836 service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59526444-6752-4a03-8483-2736cf50dfd1 req-bd494643-8a6b-4802-b304-ef71d123e836 service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-59526444-6752-4a03-8483-2736cf50dfd1 req-bd494643-8a6b-4802-b304-ef71d123e836 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] No waiting events found dispatching network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:50 user nova-compute[75288]: WARNING nova.compute.manager [req-59526444-6752-4a03-8483-2736cf50dfd1 req-bd494643-8a6b-4802-b304-ef71d123e836 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received unexpected event network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a for instance with vm_state active and task_state None.
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No VIF found with MAC fa:16:3e:b5:77:ab, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-6f865d1b-b9b0-44df-bb65-10db64f26327 req-5fb9873e-625d-481c-b753-5b832d0484be service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updated VIF entry in instance network info cache for port b3321e01-4a80-47be-b8e3-bcc3dea4b62a. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-6f865d1b-b9b0-44df-bb65-10db64f26327 req-5fb9873e-625d-481c-b753-5b832d0484be service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f865d1b-b9b0-44df-bb65-10db64f26327 req-5fb9873e-625d-481c-b753-5b832d0484be service nova] Releasing lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:50:50 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Dec 01 13:50:50 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1037148651</nova:name>
Dec 01 13:50:50 user nova-compute[75288]:   <nova:creationTime>2023-12-01 13:50:50</nova:creationTime>
Dec 01 13:50:50 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Dec 01 13:50:50 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Dec 01 13:50:50 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Dec 01 13:50:50 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Dec 01 13:50:50 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:50:50 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Dec 01 13:50:50 user nova-compute[75288]:   </nova:flavor>
Dec 01 13:50:50 user nova-compute[75288]:   <nova:owner>
Dec 01 13:50:50 user nova-compute[75288]:     <nova:user uuid="d3da01fd9ed04c2984868b13e38d3983">tempest-TaggedAttachmentsTest-799909704-project-member</nova:user>
Dec 01 13:50:50 user nova-compute[75288]:     <nova:project uuid="8f7111fdc7a44f539b3c53ac5c7b4961">tempest-TaggedAttachmentsTest-799909704</nova:project>
Dec 01 13:50:50 user nova-compute[75288]:   </nova:owner>
Dec 01 13:50:50 user nova-compute[75288]:   <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:50:50 user nova-compute[75288]:   <nova:ports>
Dec 01 13:50:50 user nova-compute[75288]:     <nova:port uuid="149cf680-382c-459a-873b-fb777184f080">
Dec 01 13:50:50 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:50:50 user nova-compute[75288]:     </nova:port>
Dec 01 13:50:50 user nova-compute[75288]:     <nova:port uuid="b3321e01-4a80-47be-b8e3-bcc3dea4b62a">
Dec 01 13:50:50 user nova-compute[75288]:       <nova:ip type="fixed" address="10.10.10.229" ipVersion="4"/>
Dec 01 13:50:50 user nova-compute[75288]:     </nova:port>
Dec 01 13:50:50 user nova-compute[75288]:   </nova:ports>
Dec 01 13:50:50 user nova-compute[75288]: </nova:instance>
Dec 01 13:50:50 user nova-compute[75288]:  {{(pid=75288) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2e287080-9e42-4184-a774-0113cb0375d9 tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "interface-b6118993-49ad-4e01-8b70-e79eaf510b59-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.894s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lazy-loading 'flavor' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:50 user nova-compute[75288]: INFO nova.compute.manager [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Attaching volume 27816711-8e39-4652-acc2-273d910465b1 to /dev/vdb
Dec 01 13:50:50 user nova-compute[75288]: DEBUG os_brick.utils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb2d5e-2e8d-4355-81df-07e588a15ad2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2221cc1-ea5d-4046-8289-a4fc21cbacec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a326d162-fe8c-43a5-9e97-02c8f2357248]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da002457-d27b-437b-aba4-5ddb97ef756d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:50:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:50:51 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:50:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e95ad3-8d62-45c7-8635-cc33ba0c3017]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:50:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:50:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:50:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:50:51 user nova-compute[75288]: DEBUG os_brick.utils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:50:51 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating existing volume attachment record: dac14a28-c043-4c08-b267-c4b873a810c6 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:50:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9eabbcb8-0fb2-4ebb-93aa-8da0560d8400 req-d40da824-1bc6-4ecc-abb7-15610941ba92 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9eabbcb8-0fb2-4ebb-93aa-8da0560d8400 req-d40da824-1bc6-4ecc-abb7-15610941ba92 service nova] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9eabbcb8-0fb2-4ebb-93aa-8da0560d8400 req-d40da824-1bc6-4ecc-abb7-15610941ba92 service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9eabbcb8-0fb2-4ebb-93aa-8da0560d8400 req-d40da824-1bc6-4ecc-abb7-15610941ba92 service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9eabbcb8-0fb2-4ebb-93aa-8da0560d8400 req-d40da824-1bc6-4ecc-abb7-15610941ba92 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] No waiting events found dispatching network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:52 user nova-compute[75288]: WARNING nova.compute.manager [req-9eabbcb8-0fb2-4ebb-93aa-8da0560d8400 req-d40da824-1bc6-4ecc-abb7-15610941ba92 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received unexpected event network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a for instance with vm_state active and task_state None.
Dec 01 13:50:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "aecbeec1-872e-48d9-beb1-cf520b587d54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:50:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:53 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:50:53 user nova-compute[75288]: INFO nova.compute.claims [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Claim successful on node user
Dec 01 13:50:53 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:50:53 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:50:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:50:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.policy [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e299489ce6ea49ba9fd3bd83a44002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51003ff129d43df8b28f33bae48350c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:50:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Creating image(s)
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "/opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "/opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "/opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk 1073741824" returned: 0 in 0.057s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Successfully created port: 8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Cannot resize image /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Ensure instance console log exists: /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Successfully updated port: 8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquired lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-4d437b99-ebd3-4f48-86b7-e6a418e41df8 req-7bb0756b-3f67-4460-8942-a247be9fbc13 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received event network-changed-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-4d437b99-ebd3-4f48-86b7-e6a418e41df8 req-7bb0756b-3f67-4460-8942-a247be9fbc13 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Refreshing instance network info cache due to event network-changed-8d372dd0-2288-4aa0-912c-e610b7a0df38. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4d437b99-ebd3-4f48-86b7-e6a418e41df8 req-7bb0756b-3f67-4460-8942-a247be9fbc13 service nova] Acquiring lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Updating instance_info_cache with network_info: [{"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Releasing lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Instance network_info: |[{"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4d437b99-ebd3-4f48-86b7-e6a418e41df8 req-7bb0756b-3f67-4460-8942-a247be9fbc13 service nova] Acquired lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-4d437b99-ebd3-4f48-86b7-e6a418e41df8 req-7bb0756b-3f67-4460-8942-a247be9fbc13 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Refreshing network info cache for port 8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Start _get_guest_xml network_info=[{"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:50:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:50:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:50:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-431956080',display_name='tempest-ServersNegativeTestJSON-server-431956080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-431956080',id=24,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d51003ff129d43df8b28f33bae48350c',ramdisk_id='',reservation_id='r-315z5rac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1610504678',owner_user_name='tempest-ServersNegativeTestJSON-1610504678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:50:54Z,user_data=None,user_id='e299489ce6ea49ba9fd3bd83a44002c4',uuid=aecbeec1-872e-48d9-beb1-cf520b587d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converting VIF {"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:96:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d372dd0-2288-4aa0-912c-e610b7a0df38,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d372dd0-22') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lazy-loading 'pci_devices' on Instance uuid aecbeec1-872e-48d9-beb1-cf520b587d54 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:50:56 user nova-compute[75288]:   <uuid>aecbeec1-872e-48d9-beb1-cf520b587d54</uuid>
Dec 01 13:50:56 user nova-compute[75288]:   <name>instance-00000018</name>
Dec 01 13:50:56 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:50:56 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:50:56 user nova-compute[75288]:   <metadata>
Dec 01 13:50:56 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:50:56 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:50:56 user nova-compute[75288]:       <nova:name>tempest-ServersNegativeTestJSON-server-431956080</nova:name>
Dec 01 13:50:56 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:50:55</nova:creationTime>
Dec 01 13:50:56 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:50:56 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:50:56 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:50:56 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:50:56 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:50:56 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:50:56 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:50:56 user nova-compute[75288]:       <nova:owner>
Dec 01 13:50:56 user nova-compute[75288]:         <nova:user uuid="e299489ce6ea49ba9fd3bd83a44002c4">tempest-ServersNegativeTestJSON-1610504678-project-member</nova:user>
Dec 01 13:50:56 user nova-compute[75288]:         <nova:project uuid="d51003ff129d43df8b28f33bae48350c">tempest-ServersNegativeTestJSON-1610504678</nova:project>
Dec 01 13:50:56 user nova-compute[75288]:       </nova:owner>
Dec 01 13:50:56 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:50:56 user nova-compute[75288]:       <nova:ports>
Dec 01 13:50:56 user nova-compute[75288]:         <nova:port uuid="8d372dd0-2288-4aa0-912c-e610b7a0df38">
Dec 01 13:50:56 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 13:50:56 user nova-compute[75288]:         </nova:port>
Dec 01 13:50:56 user nova-compute[75288]:       </nova:ports>
Dec 01 13:50:56 user nova-compute[75288]:     </nova:instance>
Dec 01 13:50:56 user nova-compute[75288]:   </metadata>
Dec 01 13:50:56 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:50:56 user nova-compute[75288]:     <system>
Dec 01 13:50:56 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:50:56 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:50:56 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:50:56 user nova-compute[75288]:       <entry name="serial">aecbeec1-872e-48d9-beb1-cf520b587d54</entry>
Dec 01 13:50:56 user nova-compute[75288]:       <entry name="uuid">aecbeec1-872e-48d9-beb1-cf520b587d54</entry>
Dec 01 13:50:56 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:50:56 user nova-compute[75288]:     </system>
Dec 01 13:50:56 user nova-compute[75288]:   </sysinfo>
Dec 01 13:50:56 user nova-compute[75288]:   <os>
Dec 01 13:50:56 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:50:56 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:50:56 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:50:56 user nova-compute[75288]:   </os>
Dec 01 13:50:56 user nova-compute[75288]:   <features>
Dec 01 13:50:56 user nova-compute[75288]:     <acpi/>
Dec 01 13:50:56 user nova-compute[75288]:     <apic/>
Dec 01 13:50:56 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:50:56 user nova-compute[75288]:   </features>
Dec 01 13:50:56 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:50:56 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:50:56 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:50:56 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:50:56 user nova-compute[75288]:   </clock>
Dec 01 13:50:56 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:50:56 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:50:56 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:50:56 user nova-compute[75288]:   </cpu>
Dec 01 13:50:56 user nova-compute[75288]:   <devices>
Dec 01 13:50:56 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:50:56 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:50:56 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk"/>
Dec 01 13:50:56 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:50:56 user nova-compute[75288]:     </disk>
Dec 01 13:50:56 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:50:56 user nova-compute[75288]:       <mac address="fa:16:3e:29:96:fc"/>
Dec 01 13:50:56 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:50:56 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:50:56 user nova-compute[75288]:       <target dev="tap8d372dd0-22"/>
Dec 01 13:50:56 user nova-compute[75288]:     </interface>
Dec 01 13:50:56 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:50:56 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/console.log" append="off"/>
Dec 01 13:50:56 user nova-compute[75288]:     </serial>
Dec 01 13:50:56 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:50:56 user nova-compute[75288]:     <video>
Dec 01 13:50:56 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:50:56 user nova-compute[75288]:     </video>
Dec 01 13:50:56 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:50:56 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:50:56 user nova-compute[75288]:     </rng>
Dec 01 13:50:56 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:50:56 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:50:56 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:50:56 user nova-compute[75288]:     </memballoon>
Dec 01 13:50:56 user nova-compute[75288]:   </devices>
Dec 01 13:50:56 user nova-compute[75288]: </domain>
Dec 01 13:50:56 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-431956080',display_name='tempest-ServersNegativeTestJSON-server-431956080',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-431956080',id=24,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d51003ff129d43df8b28f33bae48350c',ramdisk_id='',reservation_id='r-315z5rac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1610504678',owner_user_name='tempest-ServersNegativeTestJSON-1610504678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:50:54Z,user_data=None,user_id='e299489ce6ea49ba9fd3bd83a44002c4',uuid=aecbeec1-872e-48d9-beb1-cf520b587d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converting VIF {"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:96:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d372dd0-2288-4aa0-912c-e610b7a0df38,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d372dd0-22') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG os_vif [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:96:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d372dd0-2288-4aa0-912c-e610b7a0df38,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d372dd0-22') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e1ff4c7-49a9-5e00-91d1-8129e44e469e', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d372dd0-22, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d372dd0-22, col_values=(('qos', UUID('35c46479-e661-42aa-bb3a-4a8122a76c8d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d372dd0-22, col_values=(('external_ids', {'iface-id': '8d372dd0-2288-4aa0-912c-e610b7a0df38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:96:fc', 'vm-uuid': 'aecbeec1-872e-48d9-beb1-cf520b587d54'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:56 user nova-compute[75288]: INFO os_vif [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:96:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d372dd0-2288-4aa0-912c-e610b7a0df38,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d372dd0-22')
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] No VIF found with MAC fa:16:3e:29:96:fc, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-4d437b99-ebd3-4f48-86b7-e6a418e41df8 req-7bb0756b-3f67-4460-8942-a247be9fbc13 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Updated VIF entry in instance network info cache for port 8d372dd0-2288-4aa0-912c-e610b7a0df38. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-4d437b99-ebd3-4f48-86b7-e6a418e41df8 req-7bb0756b-3f67-4460-8942-a247be9fbc13 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Updating instance_info_cache with network_info: [{"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:50:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4d437b99-ebd3-4f48-86b7-e6a418e41df8 req-7bb0756b-3f67-4460-8942-a247be9fbc13 service nova] Releasing lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-59a97541-30ef-4490-84d6-6c520be3eeb7 req-4be47309-bce3-4674-997f-3c6cc2727516 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received event network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59a97541-30ef-4490-84d6-6c520be3eeb7 req-4be47309-bce3-4674-997f-3c6cc2727516 service nova] Acquiring lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59a97541-30ef-4490-84d6-6c520be3eeb7 req-4be47309-bce3-4674-997f-3c6cc2727516 service nova] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-59a97541-30ef-4490-84d6-6c520be3eeb7 req-4be47309-bce3-4674-997f-3c6cc2727516 service nova] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-59a97541-30ef-4490-84d6-6c520be3eeb7 req-4be47309-bce3-4674-997f-3c6cc2727516 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] No waiting events found dispatching network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:57 user nova-compute[75288]: WARNING nova.compute.manager [req-59a97541-30ef-4490-84d6-6c520be3eeb7 req-4be47309-bce3-4674-997f-3c6cc2727516 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received unexpected event network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 for instance with vm_state building and task_state spawning.
Dec 01 13:50:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:50:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Instance spawned successfully.
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:50:59 user nova-compute[75288]: INFO nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Took 5.63 seconds to spawn the instance on the hypervisor.
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-29bd61d4-ac09-404a-aa4e-327579d8ab21 req-0ef4bdfd-e770-4021-a78f-cc353d27006c service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received event network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-29bd61d4-ac09-404a-aa4e-327579d8ab21 req-0ef4bdfd-e770-4021-a78f-cc353d27006c service nova] Acquiring lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-29bd61d4-ac09-404a-aa4e-327579d8ab21 req-0ef4bdfd-e770-4021-a78f-cc353d27006c service nova] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-29bd61d4-ac09-404a-aa4e-327579d8ab21 req-0ef4bdfd-e770-4021-a78f-cc353d27006c service nova] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:50:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-29bd61d4-ac09-404a-aa4e-327579d8ab21 req-0ef4bdfd-e770-4021-a78f-cc353d27006c service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] No waiting events found dispatching network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:50:59 user nova-compute[75288]: WARNING nova.compute.manager [req-29bd61d4-ac09-404a-aa4e-327579d8ab21 req-0ef4bdfd-e770-4021-a78f-cc353d27006c service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received unexpected event network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 for instance with vm_state building and task_state spawning.
Dec 01 13:50:59 user nova-compute[75288]: INFO nova.compute.manager [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Took 6.42 seconds to build instance.
Dec 01 13:50:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c59c455-f503-4817-b268-8b3244d26c9c tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.526s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMPHlBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:51:00 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:51:00 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:51:00 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5dce7c-5e13-413a-b98c-1ca1ef551446]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:51:00 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c482e8ad-8a11-4006-89bf-f34ef3317f01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1] added
Dec 01 13:51:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d193249-c439-4ec6-803b-1f3ddfbf0fcb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b5fd83-a982-4c7a-8586-2be4c3f5a39c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMPHlBAt {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UMPHlBAt" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9a1767-8f4d-4bfa-b2b6-15873b8be469]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UMPHlBAt'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[175b463d-296a-4ace-95d3-de86d4579e7c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ae6b21-a9d8-401d-9a9f-2724007ca8ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b671a67-ec99-4b3f-82c3-d05b14975a8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1, portal: 172.16.0.220,3260]
Dec 01 13:51:00 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1, portal: 172.16.0.220,3260] successful.
Dec 01 13:51:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[237ea2d4-0ef4-4ce8-acc6-c7dc9f1ae2af]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d063a1-ba94-45a5-8148-08763e8e4d3a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:00 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 (non-flash)
Dec 01 13:51:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:00 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 (non-flash)
Dec 01 13:51:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[723076ff-fd09-4322-8814-3b95764d4669]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:51:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:01 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:51:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMPHlBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:51:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:51:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23338626363306163', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:51:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338626363306163', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:51:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lazy-loading 'flavor' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:51:01 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:51:01 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:51:01 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:51:01 user nova-compute[75288]:   <serial>27816711-8e39-4652-acc2-273d910465b1</serial>
Dec 01 13:51:01 user nova-compute[75288]: </disk>
Dec 01 13:51:01 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:51:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:51:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No BDM found with device name hda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:51:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] No VIF found with MAC fa:16:3e:b5:77:ab, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:51:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e800ecc2-4712-4812-94dc-830b5c13217f tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.412s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:03 user nova-compute[75288]: INFO nova.compute.manager [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Detaching volume 27816711-8e39-4652-acc2-273d910465b1
Dec 01 13:51:03 user nova-compute[75288]: INFO nova.virt.block_device [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Attempting to driver detach volume 27816711-8e39-4652-acc2-273d910465b1 from mountpoint /dev/vdb
Dec 01 13:51:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Attempting to detach device vdb from instance b6118993-49ad-4e01-8b70-e79eaf510b59 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:51:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:51:03 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:51:03 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:51:03 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:51:03 user nova-compute[75288]:   <serial>27816711-8e39-4652-acc2-273d910465b1</serial>
Dec 01 13:51:03 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 13:51:03 user nova-compute[75288]: </disk>
Dec 01 13:51:03 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:51:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Successfully detached device vdb from instance b6118993-49ad-4e01-8b70-e79eaf510b59 from the persistent domain config.
Dec 01 13:51:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6118993-49ad-4e01-8b70-e79eaf510b59 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:51:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:51:03 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:51:03 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 13:51:03 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:51:03 user nova-compute[75288]:   <serial>27816711-8e39-4652-acc2-273d910465b1</serial>
Dec 01 13:51:03 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 13:51:03 user nova-compute[75288]: </disk>
Dec 01 13:51:03 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:51:03 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:51:05 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:11 user nova-compute[75288]: INFO nova.compute.manager [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Terminating instance
Dec 01 13:51:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:51:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-c399386c-115d-4955-90e9-559a7057e77b req-0d91c998-0764-474f-a794-a3a23edca52c service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received event network-vif-unplugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c399386c-115d-4955-90e9-559a7057e77b req-0d91c998-0764-474f-a794-a3a23edca52c service nova] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c399386c-115d-4955-90e9-559a7057e77b req-0d91c998-0764-474f-a794-a3a23edca52c service nova] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c399386c-115d-4955-90e9-559a7057e77b req-0d91c998-0764-474f-a794-a3a23edca52c service nova] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-c399386c-115d-4955-90e9-559a7057e77b req-0d91c998-0764-474f-a794-a3a23edca52c service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] No waiting events found dispatching network-vif-unplugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-c399386c-115d-4955-90e9-559a7057e77b req-0d91c998-0764-474f-a794-a3a23edca52c service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received event network-vif-unplugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:51:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Instance destroyed successfully.
Dec 01 13:51:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lazy-loading 'resources' on Instance uuid d000b879-6b79-4f80-a69d-548d8108c1ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:12 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:51:12 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:51:12 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7313MB free_disk=25.288265228271484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:48:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1203900004',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1203900004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1203900',id=18,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9GOodf5mR9oTrjcjLJOV/QADGlL2Cbk3WhS6rmusV4eTmWVYzoixK6ulVZ0RHn9pMNdhycljMxlw4ONf5IPnu2PPAIL565EZgzJ8M89yWcq5lzDyzGRPDti7ve/LWC9w==',key_name='tempest-keypair-474320352',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ccafe7cd43a4946bf78cc6ed7f8e889',ramdisk_id='',reservation_id='r-1wojr0jk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-789868515',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed40cc9c841944479fe35d4b1f564506',uuid=d000b879-6b79-4f80-a69d-548d8108c1ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Converting VIF {"id": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "address": "fa:16:3e:c6:93:91", "network": {"id": "1861dc26-c3f9-411c-b1ce-89da94669940", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1729523174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ccafe7cd43a4946bf78cc6ed7f8e889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf515fe97-64", "ovs_interfaceid": "f515fe97-64dc-4a0c-89e7-0378f1d90379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:93:91,bridge_name='br-int',has_traffic_filtering=True,id=f515fe97-64dc-4a0c-89e7-0378f1d90379,network=Network(1861dc26-c3f9-411c-b1ce-89da94669940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf515fe97-64') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG os_vif [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:93:91,bridge_name='br-int',has_traffic_filtering=True,id=f515fe97-64dc-4a0c-89e7-0378f1d90379,network=Network(1861dc26-c3f9-411c-b1ce-89da94669940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf515fe97-64') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf515fe97-64, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ca717a4-5486-49f4-ae13-06cfbebd3225) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:13 user nova-compute[75288]: INFO os_vif [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:93:91,bridge_name='br-int',has_traffic_filtering=True,id=f515fe97-64dc-4a0c-89e7-0378f1d90379,network=Network(1861dc26-c3f9-411c-b1ce-89da94669940),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf515fe97-64')
Dec 01 13:51:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Deleting instance files /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae_del
Dec 01 13:51:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Deletion of /opt/stack/data/nova/instances/d000b879-6b79-4f80-a69d-548d8108c1ae_del complete
Dec 01 13:51:13 user nova-compute[75288]: INFO nova.compute.manager [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Took 1.22 seconds to destroy the instance on the hypervisor.
Dec 01 13:51:13 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 64e25352-1ed2-4eda-a376-cb722f0b779f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d000b879-6b79-4f80-a69d-548d8108c1ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b6118993-49ad-4e01-8b70-e79eaf510b59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e6194101-1671-4beb-bc96-ed503be7fb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:13 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Took 0.76 seconds to deallocate network for instance.
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-f0734a06-77f0-4a2d-94f1-336d28f7719a req-300b4dd0-c3e1-4a80-89d3-aa646fd0c36f service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received event network-vif-deleted-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:13 user nova-compute[75288]: INFO nova.compute.manager [req-f0734a06-77f0-4a2d-94f1-336d28f7719a req-300b4dd0-c3e1-4a80-89d3-aa646fd0c36f service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Neutron deleted interface f515fe97-64dc-4a0c-89e7-0378f1d90379; detaching it from the instance and deleting it from the info cache
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-f0734a06-77f0-4a2d-94f1-336d28f7719a req-300b4dd0-c3e1-4a80-89d3-aa646fd0c36f service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-f0734a06-77f0-4a2d-94f1-336d28f7719a req-300b4dd0-c3e1-4a80-89d3-aa646fd0c36f service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Detach interface failed, port_id=f515fe97-64dc-4a0c-89e7-0378f1d90379, reason: Instance d000b879-6b79-4f80-a69d-548d8108c1ae could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-c9eb0f28-8e0e-4c1b-b1af-09af0f442de8 req-1f1a2a6c-dcf2-4617-bae9-a556287aae95 service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received event network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9eb0f28-8e0e-4c1b-b1af-09af0f442de8 req-1f1a2a6c-dcf2-4617-bae9-a556287aae95 service nova] Acquiring lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9eb0f28-8e0e-4c1b-b1af-09af0f442de8 req-1f1a2a6c-dcf2-4617-bae9-a556287aae95 service nova] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9eb0f28-8e0e-4c1b-b1af-09af0f442de8 req-1f1a2a6c-dcf2-4617-bae9-a556287aae95 service nova] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-c9eb0f28-8e0e-4c1b-b1af-09af0f442de8 req-1f1a2a6c-dcf2-4617-bae9-a556287aae95 service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] No waiting events found dispatching network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:14 user nova-compute[75288]: WARNING nova.compute.manager [req-c9eb0f28-8e0e-4c1b-b1af-09af0f442de8 req-1f1a2a6c-dcf2-4617-bae9-a556287aae95 service nova] [instance: d000b879-6b79-4f80-a69d-548d8108c1ae] Received unexpected event network-vif-plugged-f515fe97-64dc-4a0c-89e7-0378f1d90379 for instance with vm_state deleted and task_state None.
Dec 01 13:51:14 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:14 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Deleted allocations for instance d000b879-6b79-4f80-a69d-548d8108c1ae
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cc3eb937-2ff2-4c6e-9e5d-1076c39c3eb1 tempest-TestServerVolumeAttachScenarioOldVersion-789868515 tempest-TestServerVolumeAttachScenarioOldVersion-789868515-project-member] Lock "d000b879-6b79-4f80-a69d-548d8108c1ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.710s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:51:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 03de2627-2167-48c9-94cb-bd57c18f87c8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:51:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:51:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:51:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "e6194101-1671-4beb-bc96-ed503be7fb72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "e6194101-1671-4beb-bc96-ed503be7fb72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:20 user nova-compute[75288]: INFO nova.compute.manager [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Terminating instance
Dec 01 13:51:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b2cb54e-f1e5-49a8-9f22-505d6a4570cd req-4b5d7cc8-9ca8-492d-9759-26dba56b0d40 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received event network-vif-unplugged-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b2cb54e-f1e5-49a8-9f22-505d6a4570cd req-4b5d7cc8-9ca8-492d-9759-26dba56b0d40 service nova] Acquiring lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b2cb54e-f1e5-49a8-9f22-505d6a4570cd req-4b5d7cc8-9ca8-492d-9759-26dba56b0d40 service nova] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b2cb54e-f1e5-49a8-9f22-505d6a4570cd req-4b5d7cc8-9ca8-492d-9759-26dba56b0d40 service nova] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b2cb54e-f1e5-49a8-9f22-505d6a4570cd req-4b5d7cc8-9ca8-492d-9759-26dba56b0d40 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] No waiting events found dispatching network-vif-unplugged-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b2cb54e-f1e5-49a8-9f22-505d6a4570cd req-4b5d7cc8-9ca8-492d-9759-26dba56b0d40 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received event network-vif-unplugged-b65733e1-ad7b-4afa-875d-56f147b4a252 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:51:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Instance destroyed successfully.
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.objects.instance [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lazy-loading 'resources' on Instance uuid e6194101-1671-4beb-bc96-ed503be7fb72 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-685921034',display_name='tempest-VolumesActionsTest-instance-685921034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-685921034',id=22,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34f01054a7fd41c1b36119582feb288a',ramdisk_id='',reservation_id='r-4icu5tzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-589432163',owner_user_name='tempest-VolumesActionsTest-589432163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:29Z,user_data=None,user_id='7e46a79987bb4308bdaea741c1a56d0a',uuid=e6194101-1671-4beb-bc96-ed503be7fb72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Converting VIF {"id": "b65733e1-ad7b-4afa-875d-56f147b4a252", "address": "fa:16:3e:3d:23:0f", "network": {"id": "5d90384e-bdca-46ab-b74d-5d2eb638825f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1499759794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34f01054a7fd41c1b36119582feb288a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65733e1-ad", "ovs_interfaceid": "b65733e1-ad7b-4afa-875d-56f147b4a252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:0f,bridge_name='br-int',has_traffic_filtering=True,id=b65733e1-ad7b-4afa-875d-56f147b4a252,network=Network(5d90384e-bdca-46ab-b74d-5d2eb638825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65733e1-ad') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG os_vif [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:0f,bridge_name='br-int',has_traffic_filtering=True,id=b65733e1-ad7b-4afa-875d-56f147b4a252,network=Network(5d90384e-bdca-46ab-b74d-5d2eb638825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65733e1-ad') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb65733e1-ad, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee500f11-a215-4736-8ab7-1fe827f1356f) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:21 user nova-compute[75288]: INFO os_vif [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:23:0f,bridge_name='br-int',has_traffic_filtering=True,id=b65733e1-ad7b-4afa-875d-56f147b4a252,network=Network(5d90384e-bdca-46ab-b74d-5d2eb638825f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb65733e1-ad')
Dec 01 13:51:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Deleting instance files /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72_del
Dec 01 13:51:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Deletion of /opt/stack/data/nova/instances/e6194101-1671-4beb-bc96-ed503be7fb72_del complete
Dec 01 13:51:21 user nova-compute[75288]: INFO nova.compute.manager [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 01 13:51:21 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:51:21 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:51:22 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:22 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Took 0.51 seconds to deallocate network for instance.
Dec 01 13:51:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-c315b94c-8109-4669-9920-b9457ffba91f req-8a30ee85-55b2-4419-9fa7-11d4238fad84 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received event network-vif-deleted-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:22 user nova-compute[75288]: INFO nova.compute.manager [req-c315b94c-8109-4669-9920-b9457ffba91f req-8a30ee85-55b2-4419-9fa7-11d4238fad84 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Neutron deleted interface b65733e1-ad7b-4afa-875d-56f147b4a252; detaching it from the instance and deleting it from the info cache
Dec 01 13:51:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-c315b94c-8109-4669-9920-b9457ffba91f req-8a30ee85-55b2-4419-9fa7-11d4238fad84 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-c315b94c-8109-4669-9920-b9457ffba91f req-8a30ee85-55b2-4419-9fa7-11d4238fad84 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Detach interface failed, port_id=b65733e1-ad7b-4afa-875d-56f147b4a252, reason: Instance e6194101-1671-4beb-bc96-ed503be7fb72 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:51:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:51:22 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:51:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:22 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Deleted allocations for instance e6194101-1671-4beb-bc96-ed503be7fb72
Dec 01 13:51:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8cf796e1-3c39-4794-8811-210a8430559c tempest-VolumesActionsTest-589432163 tempest-VolumesActionsTest-589432163-project-member] Lock "e6194101-1671-4beb-bc96-ed503be7fb72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-aa275a50-0536-4276-bd1c-e54ef5a9f52e req-3b740e24-e4de-44b6-948a-d619358d1441 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received event network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aa275a50-0536-4276-bd1c-e54ef5a9f52e req-3b740e24-e4de-44b6-948a-d619358d1441 service nova] Acquiring lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aa275a50-0536-4276-bd1c-e54ef5a9f52e req-3b740e24-e4de-44b6-948a-d619358d1441 service nova] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aa275a50-0536-4276-bd1c-e54ef5a9f52e req-3b740e24-e4de-44b6-948a-d619358d1441 service nova] Lock "e6194101-1671-4beb-bc96-ed503be7fb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-aa275a50-0536-4276-bd1c-e54ef5a9f52e req-3b740e24-e4de-44b6-948a-d619358d1441 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] No waiting events found dispatching network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:23 user nova-compute[75288]: WARNING nova.compute.manager [req-aa275a50-0536-4276-bd1c-e54ef5a9f52e req-3b740e24-e4de-44b6-948a-d619358d1441 service nova] [instance: e6194101-1671-4beb-bc96-ed503be7fb72] Received unexpected event network-vif-plugged-b65733e1-ad7b-4afa-875d-56f147b4a252 for instance with vm_state deleted and task_state None.
Dec 01 13:51:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6118993-49ad-4e01-8b70-e79eaf510b59 is timed out.
Dec 01 13:51:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Successfully detached device vdb from instance b6118993-49ad-4e01-8b70-e79eaf510b59 from the live domain config.
Dec 01 13:51:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UMPHlBAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:51:24 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e37864c-81cc-4037-9994-0adc10e9d307]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:51:24 user nova-compute[75288]: No targets found.
Dec 01 13:51:24 user nova-compute[75288]: iSNS:
Dec 01 13:51:24 user nova-compute[75288]: No targets found.
Dec 01 13:51:24 user nova-compute[75288]: STATIC:
Dec 01 13:51:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1
Dec 01 13:51:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:51:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:51:24 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:51:24 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:51:24 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:51:24 user nova-compute[75288]: FIRMWARE:
Dec 01 13:51:24 user nova-compute[75288]: No targets found.
Dec 01 13:51:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:51:24 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:51:24 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1d074-a3e9-4add-ac32-2c372e97abbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be2bd5-0ac6-43e3-8be1-01088a98714d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:24 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 (non-flash)
Dec 01 13:51:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:24 user nova-compute[75288]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 (non-flash)
Dec 01 13:51:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98f15f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf854400-5646-4ddb-8516-2bf52e9cfe2f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[444422ea-ace3-4a1b-b0a0-03695344d873]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48d422-1310-4f7f-8bbd-818e9018359f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff632b5-e1df-466f-828f-4cf04a8de63b]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a466734-cb8d-4dd7-8457-26607a7b88cc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[609e203c-3e54-407d-905b-4d42afce7784]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1, portal: 172.16.0.220,3260]
Dec 01 13:51:24 user nova-compute[75288]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1, portal: 172.16.0.220,3260] successful.
Dec 01 13:51:24 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27816711-8e39-4652-acc2-273d910465b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd5d85-1f3f-41c9-ae77-7029007ce8f5]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] <== disconnect_volume: return (319ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:51:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:51:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:26 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lazy-loading 'flavor' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ab2be9d-4635-46ad-8fa7-e962267351ff tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.569s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "interface-b6118993-49ad-4e01-8b70-e79eaf510b59-b3321e01-4a80-47be-b8e3-bcc3dea4b62a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "interface-b6118993-49ad-4e01-8b70-e79eaf510b59-b3321e01-4a80-47be-b8e3-bcc3dea4b62a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lazy-loading 'flavor' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converting VIF {"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Attempting to detach device tapb3321e01-4a from instance b6118993-49ad-4e01-8b70-e79eaf510b59 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] detach device xml: <interface type="ethernet">
Dec 01 13:51:27 user nova-compute[75288]:   <mac address="fa:16:3e:c5:f3:c7"/>
Dec 01 13:51:27 user nova-compute[75288]:   <model type="virtio"/>
Dec 01 13:51:27 user nova-compute[75288]:   <mtu size="1442"/>
Dec 01 13:51:27 user nova-compute[75288]:   <target dev="tapb3321e01-4a"/>
Dec 01 13:51:27 user nova-compute[75288]: </interface>
Dec 01 13:51:27 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface>not found in domain: <domain type='kvm' id='23'>
Dec 01 13:51:27 user nova-compute[75288]:   <name>instance-00000015</name>
Dec 01 13:51:27 user nova-compute[75288]:   <uuid>b6118993-49ad-4e01-8b70-e79eaf510b59</uuid>
Dec 01 13:51:27 user nova-compute[75288]:   <metadata>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:51:27 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Dec 01 13:51:27 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1037148651</nova:name>
Dec 01 13:51:27 user nova-compute[75288]:   <nova:creationTime>2023-12-01 13:50:50</nova:creationTime>
Dec 01 13:51:27 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Dec 01 13:51:27 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Dec 01 13:51:27 user nova-compute[75288]:   </nova:flavor>
Dec 01 13:51:27 user nova-compute[75288]:   <nova:owner>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:user uuid="d3da01fd9ed04c2984868b13e38d3983">tempest-TaggedAttachmentsTest-799909704-project-member</nova:user>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:project uuid="8f7111fdc7a44f539b3c53ac5c7b4961">tempest-TaggedAttachmentsTest-799909704</nova:project>
Dec 01 13:51:27 user nova-compute[75288]:   </nova:owner>
Dec 01 13:51:27 user nova-compute[75288]:   <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:51:27 user nova-compute[75288]:   <nova:ports>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:port uuid="149cf680-382c-459a-873b-fb777184f080">
Dec 01 13:51:27 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:51:27 user nova-compute[75288]:     </nova:port>
Dec 01 13:51:27 user nova-compute[75288]:     <nova:port uuid="b3321e01-4a80-47be-b8e3-bcc3dea4b62a">
Dec 01 13:51:27 user nova-compute[75288]:       <nova:ip type="fixed" address="10.10.10.229" ipVersion="4"/>
Dec 01 13:51:27 user nova-compute[75288]:     </nova:port>
Dec 01 13:51:27 user nova-compute[75288]:   </nova:ports>
Dec 01 13:51:27 user nova-compute[75288]: </nova:instance>
Dec 01 13:51:27 user nova-compute[75288]:   </metadata>
Dec 01 13:51:27 user nova-compute[75288]:   <memory unit='KiB'>524288</memory>
Dec 01 13:51:27 user nova-compute[75288]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 13:51:27 user nova-compute[75288]:   <vcpu placement='static'>1</vcpu>
Dec 01 13:51:27 user nova-compute[75288]:   <resource>
Dec 01 13:51:27 user nova-compute[75288]:     <partition>/machine</partition>
Dec 01 13:51:27 user nova-compute[75288]:   </resource>
Dec 01 13:51:27 user nova-compute[75288]:   <sysinfo type='smbios'>
Dec 01 13:51:27 user nova-compute[75288]:     <system>
Dec 01 13:51:27 user nova-compute[75288]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 13:51:27 user nova-compute[75288]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 13:51:27 user nova-compute[75288]:       <entry name='version'>0.0.0</entry>
Dec 01 13:51:27 user nova-compute[75288]:       <entry name='serial'>b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:51:27 user nova-compute[75288]:       <entry name='uuid'>b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:51:27 user nova-compute[75288]:       <entry name='family'>Virtual Machine</entry>
Dec 01 13:51:27 user nova-compute[75288]:     </system>
Dec 01 13:51:27 user nova-compute[75288]:   </sysinfo>
Dec 01 13:51:27 user nova-compute[75288]:   <os>
Dec 01 13:51:27 user nova-compute[75288]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 13:51:27 user nova-compute[75288]:     <boot dev='hd'/>
Dec 01 13:51:27 user nova-compute[75288]:     <smbios mode='sysinfo'/>
Dec 01 13:51:27 user nova-compute[75288]:   </os>
Dec 01 13:51:27 user nova-compute[75288]:   <features>
Dec 01 13:51:27 user nova-compute[75288]:     <acpi/>
Dec 01 13:51:27 user nova-compute[75288]:     <apic/>
Dec 01 13:51:27 user nova-compute[75288]:     <vmcoreinfo state='on'/>
Dec 01 13:51:27 user nova-compute[75288]:   </features>
Dec 01 13:51:27 user nova-compute[75288]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 13:51:27 user nova-compute[75288]:     <model fallback='forbid'>Nehalem</model>
Dec 01 13:51:27 user nova-compute[75288]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 13:51:27 user nova-compute[75288]:     <feature policy='require' name='vme'/>
Dec 01 13:51:27 user nova-compute[75288]:     <feature policy='require' name='x2apic'/>
Dec 01 13:51:27 user nova-compute[75288]:     <feature policy='require' name='hypervisor'/>
Dec 01 13:51:27 user nova-compute[75288]:   </cpu>
Dec 01 13:51:27 user nova-compute[75288]:   <clock offset='utc'>
Dec 01 13:51:27 user nova-compute[75288]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 13:51:27 user nova-compute[75288]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 13:51:27 user nova-compute[75288]:     <timer name='hpet' present='no'/>
Dec 01 13:51:27 user nova-compute[75288]:   </clock>
Dec 01 13:51:27 user nova-compute[75288]:   <on_poweroff>destroy</on_poweroff>
Dec 01 13:51:27 user nova-compute[75288]:   <on_reboot>restart</on_reboot>
Dec 01 13:51:27 user nova-compute[75288]:   <on_crash>destroy</on_crash>
Dec 01 13:51:27 user nova-compute[75288]:   <devices>
Dec 01 13:51:27 user nova-compute[75288]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 13:51:27 user nova-compute[75288]:     <disk type='file' device='disk'>
Dec 01 13:51:27 user nova-compute[75288]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 13:51:27 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk' index='2'/>
Dec 01 13:51:27 user nova-compute[75288]:       <backingStore type='file' index='3'>
Dec 01 13:51:27 user nova-compute[75288]:         <format type='raw'/>
Dec 01 13:51:27 user nova-compute[75288]:         <source file='/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a'/>
Dec 01 13:51:27 user nova-compute[75288]:         <backingStore/>
Dec 01 13:51:27 user nova-compute[75288]:       </backingStore>
Dec 01 13:51:27 user nova-compute[75288]:       <target dev='vda' bus='virtio'/>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='virtio-disk0'/>
Dec 01 13:51:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </disk>
Dec 01 13:51:27 user nova-compute[75288]:     <disk type='file' device='cdrom'>
Dec 01 13:51:27 user nova-compute[75288]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 13:51:27 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.config' index='1'/>
Dec 01 13:51:27 user nova-compute[75288]:       <backingStore/>
Dec 01 13:51:27 user nova-compute[75288]:       <target dev='hda' bus='ide'/>
Dec 01 13:51:27 user nova-compute[75288]:       <readonly/>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='ide0-0-0'/>
Dec 01 13:51:27 user nova-compute[75288]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </disk>
Dec 01 13:51:27 user nova-compute[75288]:     <controller type='usb' index='0' model='none'>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='usb'/>
Dec 01 13:51:27 user nova-compute[75288]:     </controller>
Dec 01 13:51:27 user nova-compute[75288]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='pci.0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </controller>
Dec 01 13:51:27 user nova-compute[75288]:     <controller type='ide' index='0'>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='ide'/>
Dec 01 13:51:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 13:51:27 user nova-compute[75288]:     </controller>
Dec 01 13:51:27 user nova-compute[75288]:     <interface type='ethernet'>
Dec 01 13:51:27 user nova-compute[75288]:       <mac address='fa:16:3e:b5:77:ab'/>
Dec 01 13:51:27 user nova-compute[75288]:       <target dev='tap149cf680-38'/>
Dec 01 13:51:27 user nova-compute[75288]:       <model type='virtio'/>
Dec 01 13:51:27 user nova-compute[75288]:       <mtu size='1442'/>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='net0'/>
Dec 01 13:51:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </interface>
Dec 01 13:51:27 user nova-compute[75288]:     <interface type='ethernet'>
Dec 01 13:51:27 user nova-compute[75288]:       <mac address='fa:16:3e:c5:f3:c7'/>
Dec 01 13:51:27 user nova-compute[75288]:       <target dev='tapb3321e01-4a'/>
Dec 01 13:51:27 user nova-compute[75288]:       <model type='virtio'/>
Dec 01 13:51:27 user nova-compute[75288]:       <mtu size='1442'/>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='net1'/>
Dec 01 13:51:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </interface>
Dec 01 13:51:27 user nova-compute[75288]:     <serial type='pty'>
Dec 01 13:51:27 user nova-compute[75288]:       <source path='/dev/pts/10'/>
Dec 01 13:51:27 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log' append='off'/>
Dec 01 13:51:27 user nova-compute[75288]:       <target type='isa-serial' port='0'>
Dec 01 13:51:27 user nova-compute[75288]:         <model name='isa-serial'/>
Dec 01 13:51:27 user nova-compute[75288]:       </target>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='serial0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </serial>
Dec 01 13:51:27 user nova-compute[75288]:     <console type='pty' tty='/dev/pts/10'>
Dec 01 13:51:27 user nova-compute[75288]:       <source path='/dev/pts/10'/>
Dec 01 13:51:27 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log' append='off'/>
Dec 01 13:51:27 user nova-compute[75288]:       <target type='serial' port='0'/>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='serial0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </console>
Dec 01 13:51:27 user nova-compute[75288]:     <input type='mouse' bus='ps2'>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='input0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </input>
Dec 01 13:51:27 user nova-compute[75288]:     <input type='keyboard' bus='ps2'>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='input1'/>
Dec 01 13:51:27 user nova-compute[75288]:     </input>
Dec 01 13:51:27 user nova-compute[75288]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 01 13:51:27 user nova-compute[75288]:       <listen type='address' address='0.0.0.0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </graphics>
Dec 01 13:51:27 user nova-compute[75288]:     <audio id='1' type='none'/>
Dec 01 13:51:27 user nova-compute[75288]:     <video>
Dec 01 13:51:27 user nova-compute[75288]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='video0'/>
Dec 01 13:51:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </video>
Dec 01 13:51:27 user nova-compute[75288]:     <memballoon model='virtio'>
Dec 01 13:51:27 user nova-compute[75288]:       <stats period='10'/>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='balloon0'/>
Dec 01 13:51:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </memballoon>
Dec 01 13:51:27 user nova-compute[75288]:     <rng model='virtio'>
Dec 01 13:51:27 user nova-compute[75288]:       <backend model='random'>/dev/urandom</backend>
Dec 01 13:51:27 user nova-compute[75288]:       <alias name='rng0'/>
Dec 01 13:51:27 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 13:51:27 user nova-compute[75288]:     </rng>
Dec 01 13:51:27 user nova-compute[75288]:   </devices>
Dec 01 13:51:27 user nova-compute[75288]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 13:51:27 user nova-compute[75288]:     <label>libvirt-b6118993-49ad-4e01-8b70-e79eaf510b59</label>
Dec 01 13:51:27 user nova-compute[75288]:     <imagelabel>libvirt-b6118993-49ad-4e01-8b70-e79eaf510b59</imagelabel>
Dec 01 13:51:27 user nova-compute[75288]:   </seclabel>
Dec 01 13:51:27 user nova-compute[75288]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 13:51:27 user nova-compute[75288]:     <label>+64055:+108</label>
Dec 01 13:51:27 user nova-compute[75288]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 13:51:27 user nova-compute[75288]:   </seclabel>
Dec 01 13:51:27 user nova-compute[75288]: </domain>
Dec 01 13:51:27 user nova-compute[75288]:  {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 13:51:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Successfully detached device tapb3321e01-4a from instance b6118993-49ad-4e01-8b70-e79eaf510b59 from the persistent domain config.
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] (1/8): Attempting to detach device tapb3321e01-4a with device alias net1 from instance b6118993-49ad-4e01-8b70-e79eaf510b59 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] detach device xml: <interface type="ethernet">
Dec 01 13:51:27 user nova-compute[75288]:   <mac address="fa:16:3e:c5:f3:c7"/>
Dec 01 13:51:27 user nova-compute[75288]:   <model type="virtio"/>
Dec 01 13:51:27 user nova-compute[75288]:   <mtu size="1442"/>
Dec 01 13:51:27 user nova-compute[75288]:   <target dev="tapb3321e01-4a"/>
Dec 01 13:51:27 user nova-compute[75288]: </interface>
Dec 01 13:51:27 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Start waiting for the detach event from libvirt for device tapb3321e01-4a with device alias net1 for instance b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:51:27 user nova-compute[75288]: INFO nova.compute.claims [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Claim successful on node user
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-da5c0ee2-7641-444c-a999-8ed33c970014 req-28f8b931-3707-403b-87c9-1e4d9602fd2f service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-unplugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da5c0ee2-7641-444c-a999-8ed33c970014 req-28f8b931-3707-403b-87c9-1e4d9602fd2f service nova] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da5c0ee2-7641-444c-a999-8ed33c970014 req-28f8b931-3707-403b-87c9-1e4d9602fd2f service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-da5c0ee2-7641-444c-a999-8ed33c970014 req-28f8b931-3707-403b-87c9-1e4d9602fd2f service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-da5c0ee2-7641-444c-a999-8ed33c970014 req-28f8b931-3707-403b-87c9-1e4d9602fd2f service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] No waiting events found dispatching network-vif-unplugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:27 user nova-compute[75288]: WARNING nova.compute.manager [req-da5c0ee2-7641-444c-a999-8ed33c970014 req-28f8b931-3707-403b-87c9-1e4d9602fd2f service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received unexpected event network-vif-unplugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a for instance with vm_state active and task_state None.
Dec 01 13:51:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:51:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:51:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:51:28 user nova-compute[75288]: INFO nova.virt.block_device [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Booting with volume bb587a52-3fa5-460e-bb89-6e50e873f6e4 at /dev/vda
Dec 01 13:51:28 user nova-compute[75288]: DEBUG nova.policy [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab6a9e09550e42edac3c1e8a9112fbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1120cc4cc3d8458aaf5755a500e994c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG os_brick.utils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5eaf29-ca4f-4f48-91d9-316b586cf5e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0781b73e-6d68-493d-bbaf-70ba752e3fec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a8f2b-a2f1-4083-8801-d6d4e8140f91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a579092f-92f8-407a-85f8-a7ac7a1dbc77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:51:28 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:51:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5985bfc5-9a5d-44e7-90b1-e871b8067327]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG os_brick.utils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updating existing volume attachment record: 284808ac-9d0e-48a3-b1ff-bcba449c9f66 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:51:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Successfully created port: f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Successfully updated port: f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquired lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3084cb7c-2ef1-4ebf-8600-de7d3a3ef6be req-90350d26-fba8-47fa-88e8-9dd5d375ef23 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-changed-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-3084cb7c-2ef1-4ebf-8600-de7d3a3ef6be req-90350d26-fba8-47fa-88e8-9dd5d375ef23 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Refreshing instance network info cache due to event network-changed-f892e403-d0f3-4631-859d-6e101c9b33de. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3084cb7c-2ef1-4ebf-8600-de7d3a3ef6be req-90350d26-fba8-47fa-88e8-9dd5d375ef23 service nova] Acquiring lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-67db6d1b-5e1a-490f-ae29-71efa6e0053c req-1bfd8407-5d3d-43cf-bea8-9288439c9b14 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67db6d1b-5e1a-490f-ae29-71efa6e0053c req-1bfd8407-5d3d-43cf-bea8-9288439c9b14 service nova] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67db6d1b-5e1a-490f-ae29-71efa6e0053c req-1bfd8407-5d3d-43cf-bea8-9288439c9b14 service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67db6d1b-5e1a-490f-ae29-71efa6e0053c req-1bfd8407-5d3d-43cf-bea8-9288439c9b14 service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-67db6d1b-5e1a-490f-ae29-71efa6e0053c req-1bfd8407-5d3d-43cf-bea8-9288439c9b14 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] No waiting events found dispatching network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:29 user nova-compute[75288]: WARNING nova.compute.manager [req-67db6d1b-5e1a-490f-ae29-71efa6e0053c req-1bfd8407-5d3d-43cf-bea8-9288439c9b14 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received unexpected event network-vif-plugged-b3321e01-4a80-47be-b8e3-bcc3dea4b62a for instance with vm_state active and task_state None.
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updating instance_info_cache with network_info: [{"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Releasing lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Instance network_info: |[{"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3084cb7c-2ef1-4ebf-8600-de7d3a3ef6be req-90350d26-fba8-47fa-88e8-9dd5d375ef23 service nova] Acquired lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-3084cb7c-2ef1-4ebf-8600-de7d3a3ef6be req-90350d26-fba8-47fa-88e8-9dd5d375ef23 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Refreshing network info cache for port f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:51:30 user nova-compute[75288]: DEBUG nova.network.neutron [req-3084cb7c-2ef1-4ebf-8600-de7d3a3ef6be req-90350d26-fba8-47fa-88e8-9dd5d375ef23 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updated VIF entry in instance network info cache for port f892e403-d0f3-4631-859d-6e101c9b33de. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:51:30 user nova-compute[75288]: DEBUG nova.network.neutron [req-3084cb7c-2ef1-4ebf-8600-de7d3a3ef6be req-90350d26-fba8-47fa-88e8-9dd5d375ef23 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updating instance_info_cache with network_info: [{"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3084cb7c-2ef1-4ebf-8600-de7d3a3ef6be req-90350d26-fba8-47fa-88e8-9dd5d375ef23 service nova] Releasing lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:51:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Creating image(s)
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Ensure instance console log exists: /opt/stack/data/nova/instances/5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Start _get_guest_xml network_info=[{"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '284808ac-9d0e-48a3-b1ff-bcba449c9f66', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KraZUmid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'serial': 'bb587a52-3fa5-460e-bb89-6e50e873f6e4'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:51:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:51:37 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KraZUmid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:51:37 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:51:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:51:37 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:51:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:51:37 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87c5b65-a276-400c-bfb6-314dcb2518d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:51:37 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b212740-cf77-4beb-abd4-77bf68c85239]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4] added
Dec 01 13:51:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cafcf6a-c9bc-44ca-890b-00f2f605b581]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[505819fd-0de9-4adb-95ad-21cc9fa8f123]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KraZUmid {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KraZUmid" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d9a617-4d6e-4c29-8f62-17b8d6aa03d2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KraZUmid'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf615b2d-ea0a-45d0-b585-655e372e418e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a1e165-2a76-4ad6-b11b-9c0446ad6e73]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c703db06-e5f7-4577-9904-9c2e69d45129]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260]
Dec 01 13:51:38 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260] successful.
Dec 01 13:51:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b39e005-b3de-4208-92ec-facfc93cbd0e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0aacb9-e342-41aa-9a79-eb100dec47c3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:38 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:51:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:51:38 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:51:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d6d462-9435-4621-8f28-2be70b06c5cd]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KraZUmid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23563383564383065', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563383564383065', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1442028936',display_name='tempest-TestVolumeBootPattern-server-1442028936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1442028936',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-jjon80zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:51:28Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=f892e403-d0f3-4631-859d-6e101c9b33de,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf892e403-d0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:51:39 user nova-compute[75288]:   <uuid>5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f</uuid>
Dec 01 13:51:39 user nova-compute[75288]:   <name>instance-00000019</name>
Dec 01 13:51:39 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:51:39 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:51:39 user nova-compute[75288]:   <metadata>
Dec 01 13:51:39 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:51:39 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:51:39 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-server-1442028936</nova:name>
Dec 01 13:51:39 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:51:37</nova:creationTime>
Dec 01 13:51:39 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:51:39 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:51:39 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:51:39 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:51:39 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:51:39 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:51:39 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:51:39 user nova-compute[75288]:       <nova:owner>
Dec 01 13:51:39 user nova-compute[75288]:         <nova:user uuid="ab6a9e09550e42edac3c1e8a9112fbd1">tempest-TestVolumeBootPattern-367476607-project-member</nova:user>
Dec 01 13:51:39 user nova-compute[75288]:         <nova:project uuid="1120cc4cc3d8458aaf5755a500e994c6">tempest-TestVolumeBootPattern-367476607</nova:project>
Dec 01 13:51:39 user nova-compute[75288]:       </nova:owner>
Dec 01 13:51:39 user nova-compute[75288]:       <nova:ports>
Dec 01 13:51:39 user nova-compute[75288]:         <nova:port uuid="f892e403-d0f3-4631-859d-6e101c9b33de">
Dec 01 13:51:39 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:51:39 user nova-compute[75288]:         </nova:port>
Dec 01 13:51:39 user nova-compute[75288]:       </nova:ports>
Dec 01 13:51:39 user nova-compute[75288]:     </nova:instance>
Dec 01 13:51:39 user nova-compute[75288]:   </metadata>
Dec 01 13:51:39 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:51:39 user nova-compute[75288]:     <system>
Dec 01 13:51:39 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:51:39 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:51:39 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:51:39 user nova-compute[75288]:       <entry name="serial">5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f</entry>
Dec 01 13:51:39 user nova-compute[75288]:       <entry name="uuid">5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f</entry>
Dec 01 13:51:39 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:51:39 user nova-compute[75288]:     </system>
Dec 01 13:51:39 user nova-compute[75288]:   </sysinfo>
Dec 01 13:51:39 user nova-compute[75288]:   <os>
Dec 01 13:51:39 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:51:39 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:51:39 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:51:39 user nova-compute[75288]:   </os>
Dec 01 13:51:39 user nova-compute[75288]:   <features>
Dec 01 13:51:39 user nova-compute[75288]:     <acpi/>
Dec 01 13:51:39 user nova-compute[75288]:     <apic/>
Dec 01 13:51:39 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:51:39 user nova-compute[75288]:   </features>
Dec 01 13:51:39 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:51:39 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:51:39 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:51:39 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:51:39 user nova-compute[75288]:   </clock>
Dec 01 13:51:39 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:51:39 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:51:39 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:51:39 user nova-compute[75288]:   </cpu>
Dec 01 13:51:39 user nova-compute[75288]:   <devices>
Dec 01 13:51:39 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:51:39 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:51:39 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Dec 01 13:51:39 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:51:39 user nova-compute[75288]:       <serial>bb587a52-3fa5-460e-bb89-6e50e873f6e4</serial>
Dec 01 13:51:39 user nova-compute[75288]:     </disk>
Dec 01 13:51:39 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:51:39 user nova-compute[75288]:       <mac address="fa:16:3e:12:42:d2"/>
Dec 01 13:51:39 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:51:39 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:51:39 user nova-compute[75288]:       <target dev="tapf892e403-d0"/>
Dec 01 13:51:39 user nova-compute[75288]:     </interface>
Dec 01 13:51:39 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:51:39 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f/console.log" append="off"/>
Dec 01 13:51:39 user nova-compute[75288]:     </serial>
Dec 01 13:51:39 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:51:39 user nova-compute[75288]:     <video>
Dec 01 13:51:39 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:51:39 user nova-compute[75288]:     </video>
Dec 01 13:51:39 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:51:39 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:51:39 user nova-compute[75288]:     </rng>
Dec 01 13:51:39 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:51:39 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:51:39 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:51:39 user nova-compute[75288]:     </memballoon>
Dec 01 13:51:39 user nova-compute[75288]:   </devices>
Dec 01 13:51:39 user nova-compute[75288]: </domain>
Dec 01 13:51:39 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1442028936',display_name='tempest-TestVolumeBootPattern-server-1442028936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1442028936',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-jjon80zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:51:28Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=f892e403-d0f3-4631-859d-6e101c9b33de,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf892e403-d0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG os_vif [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=f892e403-d0f3-4631-859d-6e101c9b33de,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf892e403-d0') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '025fc0c4-86a8-5fac-9c15-5f9509f56cea', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf892e403-d0, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf892e403-d0, col_values=(('qos', UUID('bdde2589-1650-49d2-ad89-16310ebe331b')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf892e403-d0, col_values=(('external_ids', {'iface-id': 'f892e403-d0f3-4631-859d-6e101c9b33de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:42:d2', 'vm-uuid': '5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:39 user nova-compute[75288]: INFO os_vif [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=f892e403-d0f3-4631-859d-6e101c9b33de,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf892e403-d0')
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:51:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] No VIF found with MAC fa:16:3e:12:42:d2, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:51:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-c9004611-9f54-4cea-b7d6-c7ad2317b37d req-2f1daaeb-911f-4777-aba7-0c1c8bc94d6a service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9004611-9f54-4cea-b7d6-c7ad2317b37d req-2f1daaeb-911f-4777-aba7-0c1c8bc94d6a service nova] Acquiring lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9004611-9f54-4cea-b7d6-c7ad2317b37d req-2f1daaeb-911f-4777-aba7-0c1c8bc94d6a service nova] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c9004611-9f54-4cea-b7d6-c7ad2317b37d req-2f1daaeb-911f-4777-aba7-0c1c8bc94d6a service nova] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-c9004611-9f54-4cea-b7d6-c7ad2317b37d req-2f1daaeb-911f-4777-aba7-0c1c8bc94d6a service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] No waiting events found dispatching network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:41 user nova-compute[75288]: WARNING nova.compute.manager [req-c9004611-9f54-4cea-b7d6-c7ad2317b37d req-2f1daaeb-911f-4777-aba7-0c1c8bc94d6a service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received unexpected event network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de for instance with vm_state building and task_state spawning.
Dec 01 13:51:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:51:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Instance spawned successfully.
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-e368264e-6200-4be2-b87a-c4a179252366 req-e799dd86-d2fc-4983-9f3d-84c390ca024b service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e368264e-6200-4be2-b87a-c4a179252366 req-e799dd86-d2fc-4983-9f3d-84c390ca024b service nova] Acquiring lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e368264e-6200-4be2-b87a-c4a179252366 req-e799dd86-d2fc-4983-9f3d-84c390ca024b service nova] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e368264e-6200-4be2-b87a-c4a179252366 req-e799dd86-d2fc-4983-9f3d-84c390ca024b service nova] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-e368264e-6200-4be2-b87a-c4a179252366 req-e799dd86-d2fc-4983-9f3d-84c390ca024b service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] No waiting events found dispatching network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:43 user nova-compute[75288]: WARNING nova.compute.manager [req-e368264e-6200-4be2-b87a-c4a179252366 req-e799dd86-d2fc-4983-9f3d-84c390ca024b service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received unexpected event network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de for instance with vm_state building and task_state spawning.
Dec 01 13:51:43 user nova-compute[75288]: INFO nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Took 5.40 seconds to spawn the instance on the hypervisor.
Dec 01 13:51:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:51:43 user nova-compute[75288]: INFO nova.compute.manager [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Took 15.78 seconds to build instance.
Dec 01 13:51:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f9dace13-8326-47e0-bc24-29ba3bf65ac7 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.922s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:51:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:51:45 user nova-compute[75288]: INFO nova.compute.claims [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Claim successful on node user
Dec 01 13:51:45 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:51:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:51:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:51:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG nova.policy [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cad75165194843718ebc8b886ab3b6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5854339bf9c4f3db4a3bf2c65ddc344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:51:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Creating image(s)
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.275s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.211s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk 1073741824" returned: 0 in 0.056s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.281s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Successfully created port: d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:51:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Waiting for libvirt event about the detach of device tapb3321e01-4a with device alias net1 from instance b6118993-49ad-4e01-8b70-e79eaf510b59 is timed out.
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Cannot resize image /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Ensure instance console log exists: /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface>not found in domain: <domain type='kvm' id='23'>
Dec 01 13:51:47 user nova-compute[75288]:   <name>instance-00000015</name>
Dec 01 13:51:47 user nova-compute[75288]:   <uuid>b6118993-49ad-4e01-8b70-e79eaf510b59</uuid>
Dec 01 13:51:47 user nova-compute[75288]:   <metadata>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:51:47 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1037148651</nova:name>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:creationTime>2023-12-01 13:50:50</nova:creationTime>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Dec 01 13:51:47 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Dec 01 13:51:47 user nova-compute[75288]:   </nova:flavor>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:owner>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:user uuid="d3da01fd9ed04c2984868b13e38d3983">tempest-TaggedAttachmentsTest-799909704-project-member</nova:user>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:project uuid="8f7111fdc7a44f539b3c53ac5c7b4961">tempest-TaggedAttachmentsTest-799909704</nova:project>
Dec 01 13:51:47 user nova-compute[75288]:   </nova:owner>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:ports>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:port uuid="149cf680-382c-459a-873b-fb777184f080">
Dec 01 13:51:47 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:51:47 user nova-compute[75288]:     </nova:port>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:port uuid="b3321e01-4a80-47be-b8e3-bcc3dea4b62a">
Dec 01 13:51:47 user nova-compute[75288]:       <nova:ip type="fixed" address="10.10.10.229" ipVersion="4"/>
Dec 01 13:51:47 user nova-compute[75288]:     </nova:port>
Dec 01 13:51:47 user nova-compute[75288]:   </nova:ports>
Dec 01 13:51:47 user nova-compute[75288]: </nova:instance>
Dec 01 13:51:47 user nova-compute[75288]:   </metadata>
Dec 01 13:51:47 user nova-compute[75288]:   <memory unit='KiB'>524288</memory>
Dec 01 13:51:47 user nova-compute[75288]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 13:51:47 user nova-compute[75288]:   <vcpu placement='static'>1</vcpu>
Dec 01 13:51:47 user nova-compute[75288]:   <resource>
Dec 01 13:51:47 user nova-compute[75288]:     <partition>/machine</partition>
Dec 01 13:51:47 user nova-compute[75288]:   </resource>
Dec 01 13:51:47 user nova-compute[75288]:   <sysinfo type='smbios'>
Dec 01 13:51:47 user nova-compute[75288]:     <system>
Dec 01 13:51:47 user nova-compute[75288]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 13:51:47 user nova-compute[75288]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 13:51:47 user nova-compute[75288]:       <entry name='version'>0.0.0</entry>
Dec 01 13:51:47 user nova-compute[75288]:       <entry name='serial'>b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:51:47 user nova-compute[75288]:       <entry name='uuid'>b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:51:47 user nova-compute[75288]:       <entry name='family'>Virtual Machine</entry>
Dec 01 13:51:47 user nova-compute[75288]:     </system>
Dec 01 13:51:47 user nova-compute[75288]:   </sysinfo>
Dec 01 13:51:47 user nova-compute[75288]:   <os>
Dec 01 13:51:47 user nova-compute[75288]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 13:51:47 user nova-compute[75288]:     <boot dev='hd'/>
Dec 01 13:51:47 user nova-compute[75288]:     <smbios mode='sysinfo'/>
Dec 01 13:51:47 user nova-compute[75288]:   </os>
Dec 01 13:51:47 user nova-compute[75288]:   <features>
Dec 01 13:51:47 user nova-compute[75288]:     <acpi/>
Dec 01 13:51:47 user nova-compute[75288]:     <apic/>
Dec 01 13:51:47 user nova-compute[75288]:     <vmcoreinfo state='on'/>
Dec 01 13:51:47 user nova-compute[75288]:   </features>
Dec 01 13:51:47 user nova-compute[75288]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 13:51:47 user nova-compute[75288]:     <model fallback='forbid'>Nehalem</model>
Dec 01 13:51:47 user nova-compute[75288]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 13:51:47 user nova-compute[75288]:     <feature policy='require' name='vme'/>
Dec 01 13:51:47 user nova-compute[75288]:     <feature policy='require' name='x2apic'/>
Dec 01 13:51:47 user nova-compute[75288]:     <feature policy='require' name='hypervisor'/>
Dec 01 13:51:47 user nova-compute[75288]:   </cpu>
Dec 01 13:51:47 user nova-compute[75288]:   <clock offset='utc'>
Dec 01 13:51:47 user nova-compute[75288]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 13:51:47 user nova-compute[75288]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 13:51:47 user nova-compute[75288]:     <timer name='hpet' present='no'/>
Dec 01 13:51:47 user nova-compute[75288]:   </clock>
Dec 01 13:51:47 user nova-compute[75288]:   <on_poweroff>destroy</on_poweroff>
Dec 01 13:51:47 user nova-compute[75288]:   <on_reboot>restart</on_reboot>
Dec 01 13:51:47 user nova-compute[75288]:   <on_crash>destroy</on_crash>
Dec 01 13:51:47 user nova-compute[75288]:   <devices>
Dec 01 13:51:47 user nova-compute[75288]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 13:51:47 user nova-compute[75288]:     <disk type='file' device='disk'>
Dec 01 13:51:47 user nova-compute[75288]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 13:51:47 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk' index='2'/>
Dec 01 13:51:47 user nova-compute[75288]:       <backingStore type='file' index='3'>
Dec 01 13:51:47 user nova-compute[75288]:         <format type='raw'/>
Dec 01 13:51:47 user nova-compute[75288]:         <source file='/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a'/>
Dec 01 13:51:47 user nova-compute[75288]:         <backingStore/>
Dec 01 13:51:47 user nova-compute[75288]:       </backingStore>
Dec 01 13:51:47 user nova-compute[75288]:       <target dev='vda' bus='virtio'/>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='virtio-disk0'/>
Dec 01 13:51:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </disk>
Dec 01 13:51:47 user nova-compute[75288]:     <disk type='file' device='cdrom'>
Dec 01 13:51:47 user nova-compute[75288]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 13:51:47 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.config' index='1'/>
Dec 01 13:51:47 user nova-compute[75288]:       <backingStore/>
Dec 01 13:51:47 user nova-compute[75288]:       <target dev='hda' bus='ide'/>
Dec 01 13:51:47 user nova-compute[75288]:       <readonly/>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='ide0-0-0'/>
Dec 01 13:51:47 user nova-compute[75288]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </disk>
Dec 01 13:51:47 user nova-compute[75288]:     <controller type='usb' index='0' model='none'>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='usb'/>
Dec 01 13:51:47 user nova-compute[75288]:     </controller>
Dec 01 13:51:47 user nova-compute[75288]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='pci.0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </controller>
Dec 01 13:51:47 user nova-compute[75288]:     <controller type='ide' index='0'>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='ide'/>
Dec 01 13:51:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 13:51:47 user nova-compute[75288]:     </controller>
Dec 01 13:51:47 user nova-compute[75288]:     <interface type='ethernet'>
Dec 01 13:51:47 user nova-compute[75288]:       <mac address='fa:16:3e:b5:77:ab'/>
Dec 01 13:51:47 user nova-compute[75288]:       <target dev='tap149cf680-38'/>
Dec 01 13:51:47 user nova-compute[75288]:       <model type='virtio'/>
Dec 01 13:51:47 user nova-compute[75288]:       <mtu size='1442'/>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='net0'/>
Dec 01 13:51:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </interface>
Dec 01 13:51:47 user nova-compute[75288]:     <serial type='pty'>
Dec 01 13:51:47 user nova-compute[75288]:       <source path='/dev/pts/10'/>
Dec 01 13:51:47 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log' append='off'/>
Dec 01 13:51:47 user nova-compute[75288]:       <target type='isa-serial' port='0'>
Dec 01 13:51:47 user nova-compute[75288]:         <model name='isa-serial'/>
Dec 01 13:51:47 user nova-compute[75288]:       </target>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='serial0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </serial>
Dec 01 13:51:47 user nova-compute[75288]:     <console type='pty' tty='/dev/pts/10'>
Dec 01 13:51:47 user nova-compute[75288]:       <source path='/dev/pts/10'/>
Dec 01 13:51:47 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log' append='off'/>
Dec 01 13:51:47 user nova-compute[75288]:       <target type='serial' port='0'/>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='serial0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </console>
Dec 01 13:51:47 user nova-compute[75288]:     <input type='mouse' bus='ps2'>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='input0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </input>
Dec 01 13:51:47 user nova-compute[75288]:     <input type='keyboard' bus='ps2'>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='input1'/>
Dec 01 13:51:47 user nova-compute[75288]:     </input>
Dec 01 13:51:47 user nova-compute[75288]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 01 13:51:47 user nova-compute[75288]:       <listen type='address' address='0.0.0.0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </graphics>
Dec 01 13:51:47 user nova-compute[75288]:     <audio id='1' type='none'/>
Dec 01 13:51:47 user nova-compute[75288]:     <video>
Dec 01 13:51:47 user nova-compute[75288]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='video0'/>
Dec 01 13:51:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </video>
Dec 01 13:51:47 user nova-compute[75288]:     <memballoon model='virtio'>
Dec 01 13:51:47 user nova-compute[75288]:       <stats period='10'/>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='balloon0'/>
Dec 01 13:51:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </memballoon>
Dec 01 13:51:47 user nova-compute[75288]:     <rng model='virtio'>
Dec 01 13:51:47 user nova-compute[75288]:       <backend model='random'>/dev/urandom</backend>
Dec 01 13:51:47 user nova-compute[75288]:       <alias name='rng0'/>
Dec 01 13:51:47 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 13:51:47 user nova-compute[75288]:     </rng>
Dec 01 13:51:47 user nova-compute[75288]:   </devices>
Dec 01 13:51:47 user nova-compute[75288]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 13:51:47 user nova-compute[75288]:     <label>libvirt-b6118993-49ad-4e01-8b70-e79eaf510b59</label>
Dec 01 13:51:47 user nova-compute[75288]:     <imagelabel>libvirt-b6118993-49ad-4e01-8b70-e79eaf510b59</imagelabel>
Dec 01 13:51:47 user nova-compute[75288]:   </seclabel>
Dec 01 13:51:47 user nova-compute[75288]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 13:51:47 user nova-compute[75288]:     <label>+64055:+108</label>
Dec 01 13:51:47 user nova-compute[75288]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 13:51:47 user nova-compute[75288]:   </seclabel>
Dec 01 13:51:47 user nova-compute[75288]: </domain>
Dec 01 13:51:47 user nova-compute[75288]:  {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 13:51:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Successfully detached device tapb3321e01-4a from instance b6118993-49ad-4e01-8b70-e79eaf510b59 from the live domain config.
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converting VIF {"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG os_vif [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3321e01-4a, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6073a5a-7763-4605-b87a-ac1656ffa938) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:47 user nova-compute[75288]: INFO os_vif [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a')
Dec 01 13:51:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:51:47 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1037148651</nova:name>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:creationTime>2023-12-01 13:51:47</nova:creationTime>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Dec 01 13:51:47 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Dec 01 13:51:47 user nova-compute[75288]:   </nova:flavor>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:owner>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:user uuid="d3da01fd9ed04c2984868b13e38d3983">tempest-TaggedAttachmentsTest-799909704-project-member</nova:user>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:project uuid="8f7111fdc7a44f539b3c53ac5c7b4961">tempest-TaggedAttachmentsTest-799909704</nova:project>
Dec 01 13:51:47 user nova-compute[75288]:   </nova:owner>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:51:47 user nova-compute[75288]:   <nova:ports>
Dec 01 13:51:47 user nova-compute[75288]:     <nova:port uuid="149cf680-382c-459a-873b-fb777184f080">
Dec 01 13:51:47 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:51:47 user nova-compute[75288]:     </nova:port>
Dec 01 13:51:47 user nova-compute[75288]:   </nova:ports>
Dec 01 13:51:47 user nova-compute[75288]: </nova:instance>
Dec 01 13:51:47 user nova-compute[75288]:  {{(pid=75288) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-deleted-b3321e01-4a80-47be-b8e3-bcc3dea4b62a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:48 user nova-compute[75288]: INFO nova.compute.manager [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Neutron deleted interface b3321e01-4a80-47be-b8e3-bcc3dea4b62a; detaching it from the instance and deleting it from the info cache
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.objects.instance [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Lazy-loading 'system_metadata' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquired lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.objects.instance [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Lazy-loading 'flavor' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.objects.base [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Object Instance<b6118993-49ad-4e01-8b70-e79eaf510b59> lazy-loaded attributes: system_metadata,flavor {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Converting VIF {"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface>not found in domain: <domain type='kvm' id='23'>
Dec 01 13:51:48 user nova-compute[75288]:   <name>instance-00000015</name>
Dec 01 13:51:48 user nova-compute[75288]:   <uuid>b6118993-49ad-4e01-8b70-e79eaf510b59</uuid>
Dec 01 13:51:48 user nova-compute[75288]:   <metadata>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:51:48 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1037148651</nova:name>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:creationTime>2023-12-01 13:51:47</nova:creationTime>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Dec 01 13:51:48 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:flavor>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:owner>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:user uuid="d3da01fd9ed04c2984868b13e38d3983">tempest-TaggedAttachmentsTest-799909704-project-member</nova:user>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:project uuid="8f7111fdc7a44f539b3c53ac5c7b4961">tempest-TaggedAttachmentsTest-799909704</nova:project>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:owner>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:ports>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:port uuid="149cf680-382c-459a-873b-fb777184f080">
Dec 01 13:51:48 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:51:48 user nova-compute[75288]:     </nova:port>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:ports>
Dec 01 13:51:48 user nova-compute[75288]: </nova:instance>
Dec 01 13:51:48 user nova-compute[75288]:   </metadata>
Dec 01 13:51:48 user nova-compute[75288]:   <memory unit='KiB'>524288</memory>
Dec 01 13:51:48 user nova-compute[75288]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 13:51:48 user nova-compute[75288]:   <vcpu placement='static'>1</vcpu>
Dec 01 13:51:48 user nova-compute[75288]:   <resource>
Dec 01 13:51:48 user nova-compute[75288]:     <partition>/machine</partition>
Dec 01 13:51:48 user nova-compute[75288]:   </resource>
Dec 01 13:51:48 user nova-compute[75288]:   <sysinfo type='smbios'>
Dec 01 13:51:48 user nova-compute[75288]:     <system>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='version'>0.0.0</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='serial'>b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='uuid'>b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='family'>Virtual Machine</entry>
Dec 01 13:51:48 user nova-compute[75288]:     </system>
Dec 01 13:51:48 user nova-compute[75288]:   </sysinfo>
Dec 01 13:51:48 user nova-compute[75288]:   <os>
Dec 01 13:51:48 user nova-compute[75288]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 13:51:48 user nova-compute[75288]:     <boot dev='hd'/>
Dec 01 13:51:48 user nova-compute[75288]:     <smbios mode='sysinfo'/>
Dec 01 13:51:48 user nova-compute[75288]:   </os>
Dec 01 13:51:48 user nova-compute[75288]:   <features>
Dec 01 13:51:48 user nova-compute[75288]:     <acpi/>
Dec 01 13:51:48 user nova-compute[75288]:     <apic/>
Dec 01 13:51:48 user nova-compute[75288]:     <vmcoreinfo state='on'/>
Dec 01 13:51:48 user nova-compute[75288]:   </features>
Dec 01 13:51:48 user nova-compute[75288]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 13:51:48 user nova-compute[75288]:     <model fallback='forbid'>Nehalem</model>
Dec 01 13:51:48 user nova-compute[75288]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 13:51:48 user nova-compute[75288]:     <feature policy='require' name='vme'/>
Dec 01 13:51:48 user nova-compute[75288]:     <feature policy='require' name='x2apic'/>
Dec 01 13:51:48 user nova-compute[75288]:     <feature policy='require' name='hypervisor'/>
Dec 01 13:51:48 user nova-compute[75288]:   </cpu>
Dec 01 13:51:48 user nova-compute[75288]:   <clock offset='utc'>
Dec 01 13:51:48 user nova-compute[75288]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 13:51:48 user nova-compute[75288]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 13:51:48 user nova-compute[75288]:     <timer name='hpet' present='no'/>
Dec 01 13:51:48 user nova-compute[75288]:   </clock>
Dec 01 13:51:48 user nova-compute[75288]:   <on_poweroff>destroy</on_poweroff>
Dec 01 13:51:48 user nova-compute[75288]:   <on_reboot>restart</on_reboot>
Dec 01 13:51:48 user nova-compute[75288]:   <on_crash>destroy</on_crash>
Dec 01 13:51:48 user nova-compute[75288]:   <devices>
Dec 01 13:51:48 user nova-compute[75288]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 13:51:48 user nova-compute[75288]:     <disk type='file' device='disk'>
Dec 01 13:51:48 user nova-compute[75288]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 13:51:48 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk' index='2'/>
Dec 01 13:51:48 user nova-compute[75288]:       <backingStore type='file' index='3'>
Dec 01 13:51:48 user nova-compute[75288]:         <format type='raw'/>
Dec 01 13:51:48 user nova-compute[75288]:         <source file='/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a'/>
Dec 01 13:51:48 user nova-compute[75288]:         <backingStore/>
Dec 01 13:51:48 user nova-compute[75288]:       </backingStore>
Dec 01 13:51:48 user nova-compute[75288]:       <target dev='vda' bus='virtio'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='virtio-disk0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </disk>
Dec 01 13:51:48 user nova-compute[75288]:     <disk type='file' device='cdrom'>
Dec 01 13:51:48 user nova-compute[75288]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 13:51:48 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.config' index='1'/>
Dec 01 13:51:48 user nova-compute[75288]:       <backingStore/>
Dec 01 13:51:48 user nova-compute[75288]:       <target dev='hda' bus='ide'/>
Dec 01 13:51:48 user nova-compute[75288]:       <readonly/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='ide0-0-0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </disk>
Dec 01 13:51:48 user nova-compute[75288]:     <controller type='usb' index='0' model='none'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='usb'/>
Dec 01 13:51:48 user nova-compute[75288]:     </controller>
Dec 01 13:51:48 user nova-compute[75288]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='pci.0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </controller>
Dec 01 13:51:48 user nova-compute[75288]:     <controller type='ide' index='0'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='ide'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 13:51:48 user nova-compute[75288]:     </controller>
Dec 01 13:51:48 user nova-compute[75288]:     <interface type='ethernet'>
Dec 01 13:51:48 user nova-compute[75288]:       <mac address='fa:16:3e:b5:77:ab'/>
Dec 01 13:51:48 user nova-compute[75288]:       <target dev='tap149cf680-38'/>
Dec 01 13:51:48 user nova-compute[75288]:       <model type='virtio'/>
Dec 01 13:51:48 user nova-compute[75288]:       <mtu size='1442'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='net0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </interface>
Dec 01 13:51:48 user nova-compute[75288]:     <serial type='pty'>
Dec 01 13:51:48 user nova-compute[75288]:       <source path='/dev/pts/10'/>
Dec 01 13:51:48 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log' append='off'/>
Dec 01 13:51:48 user nova-compute[75288]:       <target type='isa-serial' port='0'>
Dec 01 13:51:48 user nova-compute[75288]:         <model name='isa-serial'/>
Dec 01 13:51:48 user nova-compute[75288]:       </target>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='serial0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </serial>
Dec 01 13:51:48 user nova-compute[75288]:     <console type='pty' tty='/dev/pts/10'>
Dec 01 13:51:48 user nova-compute[75288]:       <source path='/dev/pts/10'/>
Dec 01 13:51:48 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log' append='off'/>
Dec 01 13:51:48 user nova-compute[75288]:       <target type='serial' port='0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='serial0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </console>
Dec 01 13:51:48 user nova-compute[75288]:     <input type='mouse' bus='ps2'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='input0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </input>
Dec 01 13:51:48 user nova-compute[75288]:     <input type='keyboard' bus='ps2'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='input1'/>
Dec 01 13:51:48 user nova-compute[75288]:     </input>
Dec 01 13:51:48 user nova-compute[75288]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 01 13:51:48 user nova-compute[75288]:       <listen type='address' address='0.0.0.0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </graphics>
Dec 01 13:51:48 user nova-compute[75288]:     <audio id='1' type='none'/>
Dec 01 13:51:48 user nova-compute[75288]:     <video>
Dec 01 13:51:48 user nova-compute[75288]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='video0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </video>
Dec 01 13:51:48 user nova-compute[75288]:     <memballoon model='virtio'>
Dec 01 13:51:48 user nova-compute[75288]:       <stats period='10'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='balloon0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </memballoon>
Dec 01 13:51:48 user nova-compute[75288]:     <rng model='virtio'>
Dec 01 13:51:48 user nova-compute[75288]:       <backend model='random'>/dev/urandom</backend>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='rng0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </rng>
Dec 01 13:51:48 user nova-compute[75288]:   </devices>
Dec 01 13:51:48 user nova-compute[75288]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 13:51:48 user nova-compute[75288]:     <label>libvirt-b6118993-49ad-4e01-8b70-e79eaf510b59</label>
Dec 01 13:51:48 user nova-compute[75288]:     <imagelabel>libvirt-b6118993-49ad-4e01-8b70-e79eaf510b59</imagelabel>
Dec 01 13:51:48 user nova-compute[75288]:   </seclabel>
Dec 01 13:51:48 user nova-compute[75288]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 13:51:48 user nova-compute[75288]:     <label>+64055:+108</label>
Dec 01 13:51:48 user nova-compute[75288]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 13:51:48 user nova-compute[75288]:   </seclabel>
Dec 01 13:51:48 user nova-compute[75288]: </domain>
Dec 01 13:51:48 user nova-compute[75288]:  {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface> {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c5:f3:c7"/><model type="virtio"/><mtu size="1442"/><target dev="tapb3321e01-4a"/></interface>not found in domain: <domain type='kvm' id='23'>
Dec 01 13:51:48 user nova-compute[75288]:   <name>instance-00000015</name>
Dec 01 13:51:48 user nova-compute[75288]:   <uuid>b6118993-49ad-4e01-8b70-e79eaf510b59</uuid>
Dec 01 13:51:48 user nova-compute[75288]:   <metadata>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:51:48 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1037148651</nova:name>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:creationTime>2023-12-01 13:51:47</nova:creationTime>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Dec 01 13:51:48 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:flavor>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:owner>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:user uuid="d3da01fd9ed04c2984868b13e38d3983">tempest-TaggedAttachmentsTest-799909704-project-member</nova:user>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:project uuid="8f7111fdc7a44f539b3c53ac5c7b4961">tempest-TaggedAttachmentsTest-799909704</nova:project>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:owner>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:ports>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:port uuid="149cf680-382c-459a-873b-fb777184f080">
Dec 01 13:51:48 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:51:48 user nova-compute[75288]:     </nova:port>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:ports>
Dec 01 13:51:48 user nova-compute[75288]: </nova:instance>
Dec 01 13:51:48 user nova-compute[75288]:   </metadata>
Dec 01 13:51:48 user nova-compute[75288]:   <memory unit='KiB'>524288</memory>
Dec 01 13:51:48 user nova-compute[75288]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 13:51:48 user nova-compute[75288]:   <vcpu placement='static'>1</vcpu>
Dec 01 13:51:48 user nova-compute[75288]:   <resource>
Dec 01 13:51:48 user nova-compute[75288]:     <partition>/machine</partition>
Dec 01 13:51:48 user nova-compute[75288]:   </resource>
Dec 01 13:51:48 user nova-compute[75288]:   <sysinfo type='smbios'>
Dec 01 13:51:48 user nova-compute[75288]:     <system>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='version'>0.0.0</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='serial'>b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='uuid'>b6118993-49ad-4e01-8b70-e79eaf510b59</entry>
Dec 01 13:51:48 user nova-compute[75288]:       <entry name='family'>Virtual Machine</entry>
Dec 01 13:51:48 user nova-compute[75288]:     </system>
Dec 01 13:51:48 user nova-compute[75288]:   </sysinfo>
Dec 01 13:51:48 user nova-compute[75288]:   <os>
Dec 01 13:51:48 user nova-compute[75288]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 13:51:48 user nova-compute[75288]:     <boot dev='hd'/>
Dec 01 13:51:48 user nova-compute[75288]:     <smbios mode='sysinfo'/>
Dec 01 13:51:48 user nova-compute[75288]:   </os>
Dec 01 13:51:48 user nova-compute[75288]:   <features>
Dec 01 13:51:48 user nova-compute[75288]:     <acpi/>
Dec 01 13:51:48 user nova-compute[75288]:     <apic/>
Dec 01 13:51:48 user nova-compute[75288]:     <vmcoreinfo state='on'/>
Dec 01 13:51:48 user nova-compute[75288]:   </features>
Dec 01 13:51:48 user nova-compute[75288]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 13:51:48 user nova-compute[75288]:     <model fallback='forbid'>Nehalem</model>
Dec 01 13:51:48 user nova-compute[75288]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 13:51:48 user nova-compute[75288]:     <feature policy='require' name='vme'/>
Dec 01 13:51:48 user nova-compute[75288]:     <feature policy='require' name='x2apic'/>
Dec 01 13:51:48 user nova-compute[75288]:     <feature policy='require' name='hypervisor'/>
Dec 01 13:51:48 user nova-compute[75288]:   </cpu>
Dec 01 13:51:48 user nova-compute[75288]:   <clock offset='utc'>
Dec 01 13:51:48 user nova-compute[75288]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 13:51:48 user nova-compute[75288]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 13:51:48 user nova-compute[75288]:     <timer name='hpet' present='no'/>
Dec 01 13:51:48 user nova-compute[75288]:   </clock>
Dec 01 13:51:48 user nova-compute[75288]:   <on_poweroff>destroy</on_poweroff>
Dec 01 13:51:48 user nova-compute[75288]:   <on_reboot>restart</on_reboot>
Dec 01 13:51:48 user nova-compute[75288]:   <on_crash>destroy</on_crash>
Dec 01 13:51:48 user nova-compute[75288]:   <devices>
Dec 01 13:51:48 user nova-compute[75288]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 13:51:48 user nova-compute[75288]:     <disk type='file' device='disk'>
Dec 01 13:51:48 user nova-compute[75288]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 13:51:48 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk' index='2'/>
Dec 01 13:51:48 user nova-compute[75288]:       <backingStore type='file' index='3'>
Dec 01 13:51:48 user nova-compute[75288]:         <format type='raw'/>
Dec 01 13:51:48 user nova-compute[75288]:         <source file='/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a'/>
Dec 01 13:51:48 user nova-compute[75288]:         <backingStore/>
Dec 01 13:51:48 user nova-compute[75288]:       </backingStore>
Dec 01 13:51:48 user nova-compute[75288]:       <target dev='vda' bus='virtio'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='virtio-disk0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </disk>
Dec 01 13:51:48 user nova-compute[75288]:     <disk type='file' device='cdrom'>
Dec 01 13:51:48 user nova-compute[75288]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 13:51:48 user nova-compute[75288]:       <source file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk.config' index='1'/>
Dec 01 13:51:48 user nova-compute[75288]:       <backingStore/>
Dec 01 13:51:48 user nova-compute[75288]:       <target dev='hda' bus='ide'/>
Dec 01 13:51:48 user nova-compute[75288]:       <readonly/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='ide0-0-0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </disk>
Dec 01 13:51:48 user nova-compute[75288]:     <controller type='usb' index='0' model='none'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='usb'/>
Dec 01 13:51:48 user nova-compute[75288]:     </controller>
Dec 01 13:51:48 user nova-compute[75288]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='pci.0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </controller>
Dec 01 13:51:48 user nova-compute[75288]:     <controller type='ide' index='0'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='ide'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 13:51:48 user nova-compute[75288]:     </controller>
Dec 01 13:51:48 user nova-compute[75288]:     <interface type='ethernet'>
Dec 01 13:51:48 user nova-compute[75288]:       <mac address='fa:16:3e:b5:77:ab'/>
Dec 01 13:51:48 user nova-compute[75288]:       <target dev='tap149cf680-38'/>
Dec 01 13:51:48 user nova-compute[75288]:       <model type='virtio'/>
Dec 01 13:51:48 user nova-compute[75288]:       <mtu size='1442'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='net0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </interface>
Dec 01 13:51:48 user nova-compute[75288]:     <serial type='pty'>
Dec 01 13:51:48 user nova-compute[75288]:       <source path='/dev/pts/10'/>
Dec 01 13:51:48 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log' append='off'/>
Dec 01 13:51:48 user nova-compute[75288]:       <target type='isa-serial' port='0'>
Dec 01 13:51:48 user nova-compute[75288]:         <model name='isa-serial'/>
Dec 01 13:51:48 user nova-compute[75288]:       </target>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='serial0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </serial>
Dec 01 13:51:48 user nova-compute[75288]:     <console type='pty' tty='/dev/pts/10'>
Dec 01 13:51:48 user nova-compute[75288]:       <source path='/dev/pts/10'/>
Dec 01 13:51:48 user nova-compute[75288]:       <log file='/opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/console.log' append='off'/>
Dec 01 13:51:48 user nova-compute[75288]:       <target type='serial' port='0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='serial0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </console>
Dec 01 13:51:48 user nova-compute[75288]:     <input type='mouse' bus='ps2'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='input0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </input>
Dec 01 13:51:48 user nova-compute[75288]:     <input type='keyboard' bus='ps2'>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='input1'/>
Dec 01 13:51:48 user nova-compute[75288]:     </input>
Dec 01 13:51:48 user nova-compute[75288]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 01 13:51:48 user nova-compute[75288]:       <listen type='address' address='0.0.0.0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </graphics>
Dec 01 13:51:48 user nova-compute[75288]:     <audio id='1' type='none'/>
Dec 01 13:51:48 user nova-compute[75288]:     <video>
Dec 01 13:51:48 user nova-compute[75288]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='video0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </video>
Dec 01 13:51:48 user nova-compute[75288]:     <memballoon model='virtio'>
Dec 01 13:51:48 user nova-compute[75288]:       <stats period='10'/>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='balloon0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </memballoon>
Dec 01 13:51:48 user nova-compute[75288]:     <rng model='virtio'>
Dec 01 13:51:48 user nova-compute[75288]:       <backend model='random'>/dev/urandom</backend>
Dec 01 13:51:48 user nova-compute[75288]:       <alias name='rng0'/>
Dec 01 13:51:48 user nova-compute[75288]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 13:51:48 user nova-compute[75288]:     </rng>
Dec 01 13:51:48 user nova-compute[75288]:   </devices>
Dec 01 13:51:48 user nova-compute[75288]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 13:51:48 user nova-compute[75288]:     <label>libvirt-b6118993-49ad-4e01-8b70-e79eaf510b59</label>
Dec 01 13:51:48 user nova-compute[75288]:     <imagelabel>libvirt-b6118993-49ad-4e01-8b70-e79eaf510b59</imagelabel>
Dec 01 13:51:48 user nova-compute[75288]:   </seclabel>
Dec 01 13:51:48 user nova-compute[75288]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 13:51:48 user nova-compute[75288]:     <label>+64055:+108</label>
Dec 01 13:51:48 user nova-compute[75288]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 13:51:48 user nova-compute[75288]:   </seclabel>
Dec 01 13:51:48 user nova-compute[75288]: </domain>
Dec 01 13:51:48 user nova-compute[75288]:  {{(pid=75288) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 13:51:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Detaching interface fa:16:3e:c5:f3:c7 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb3321e01-4a' not found.
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Converting VIF {"id": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "address": "fa:16:3e:c5:f3:c7", "network": {"id": "101cd748-67e5-44bb-8cf6-ada0dd760b50", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-735643735", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3321e01-4a", "ovs_interfaceid": "b3321e01-4a80-47be-b8e3-bcc3dea4b62a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG os_vif [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3321e01-4a, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:51:48 user nova-compute[75288]: INFO os_vif [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:c7,bridge_name='br-int',has_traffic_filtering=True,id=b3321e01-4a80-47be-b8e3-bcc3dea4b62a,network=Network(101cd748-67e5-44bb-8cf6-ada0dd760b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3321e01-4a')
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [req-c96d336a-3f5c-4652-8c28-c92165e6c61d req-894ddafd-9803-41fc-9e6b-311a3f3b1a03 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:51:48 user nova-compute[75288]:   <nova:package version="0.0.0"/>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:name>tempest-device-tagging-server-1037148651</nova:name>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:creationTime>2023-12-01 13:51:48</nova:creationTime>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:flavor name="m1.tiny">
Dec 01 13:51:48 user nova-compute[75288]:     <nova:memory>512</nova:memory>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:disk>1</nova:disk>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:swap>0</nova:swap>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:vcpus>1</nova:vcpus>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:flavor>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:owner>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:user uuid="d3da01fd9ed04c2984868b13e38d3983">tempest-TaggedAttachmentsTest-799909704-project-member</nova:user>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:project uuid="8f7111fdc7a44f539b3c53ac5c7b4961">tempest-TaggedAttachmentsTest-799909704</nova:project>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:owner>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:51:48 user nova-compute[75288]:   <nova:ports>
Dec 01 13:51:48 user nova-compute[75288]:     <nova:port uuid="149cf680-382c-459a-873b-fb777184f080">
Dec 01 13:51:48 user nova-compute[75288]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 13:51:48 user nova-compute[75288]:     </nova:port>
Dec 01 13:51:48 user nova-compute[75288]:   </nova:ports>
Dec 01 13:51:48 user nova-compute[75288]: </nova:instance>
Dec 01 13:51:48 user nova-compute[75288]:  {{(pid=75288) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Successfully updated port: d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquired lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-7421b035-18a7-4762-8242-91e5b0367a95 req-d9521efc-6642-4256-8f36-c00be1d19a0a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-changed-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-7421b035-18a7-4762-8242-91e5b0367a95 req-d9521efc-6642-4256-8f36-c00be1d19a0a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Refreshing instance network info cache due to event network-changed-d2e3b708-7d4a-4339-880a-bfe8801dadc0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:51:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7421b035-18a7-4762-8242-91e5b0367a95 req-d9521efc-6642-4256-8f36-c00be1d19a0a service nova] Acquiring lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating instance_info_cache with network_info: [{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Releasing lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance network_info: |[{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7421b035-18a7-4762-8242-91e5b0367a95 req-d9521efc-6642-4256-8f36-c00be1d19a0a service nova] Acquired lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-7421b035-18a7-4762-8242-91e5b0367a95 req-d9521efc-6642-4256-8f36-c00be1d19a0a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Refreshing network info cache for port d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Start _get_guest_xml network_info=[{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:51:49 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:51:49 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-898293798',display_name='tempest-ServerRescueNegativeTestJSON-server-898293798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-898293798',id=26,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc+Zizx0KU4YIgWRQ6wHDhgCZOBALQjYZgThcvzgaIFKNJWrmPvHt6TgjzBkijrHh+TxA9UV8Hc5NU4XjlSUVtH/24/aJnonQPBZEjENsXJ+40B6nhvTSZl28U4GD/svg==',key_name='tempest-keypair-1111385212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-7310x4vc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad75165194843718ebc8b886ab3b6b7',uuid=ce476b0b-4ed7-42bc-9801-860255953006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=d2e3b708-7d4a-4339-880a-bfe8801dadc0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e3b708-7d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'pci_devices' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:51:49 user nova-compute[75288]:   <uuid>ce476b0b-4ed7-42bc-9801-860255953006</uuid>
Dec 01 13:51:49 user nova-compute[75288]:   <name>instance-0000001a</name>
Dec 01 13:51:49 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:51:49 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:51:49 user nova-compute[75288]:   <metadata>
Dec 01 13:51:49 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:51:49 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:51:49 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-898293798</nova:name>
Dec 01 13:51:49 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:51:49</nova:creationTime>
Dec 01 13:51:49 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:51:49 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:51:49 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:51:49 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:51:49 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:51:49 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:51:49 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:51:49 user nova-compute[75288]:       <nova:owner>
Dec 01 13:51:49 user nova-compute[75288]:         <nova:user uuid="cad75165194843718ebc8b886ab3b6b7">tempest-ServerRescueNegativeTestJSON-1340015149-project-member</nova:user>
Dec 01 13:51:49 user nova-compute[75288]:         <nova:project uuid="a5854339bf9c4f3db4a3bf2c65ddc344">tempest-ServerRescueNegativeTestJSON-1340015149</nova:project>
Dec 01 13:51:49 user nova-compute[75288]:       </nova:owner>
Dec 01 13:51:49 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:51:49 user nova-compute[75288]:       <nova:ports>
Dec 01 13:51:49 user nova-compute[75288]:         <nova:port uuid="d2e3b708-7d4a-4339-880a-bfe8801dadc0">
Dec 01 13:51:49 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 13:51:49 user nova-compute[75288]:         </nova:port>
Dec 01 13:51:49 user nova-compute[75288]:       </nova:ports>
Dec 01 13:51:49 user nova-compute[75288]:     </nova:instance>
Dec 01 13:51:49 user nova-compute[75288]:   </metadata>
Dec 01 13:51:49 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:51:49 user nova-compute[75288]:     <system>
Dec 01 13:51:49 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:51:49 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:51:49 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:51:49 user nova-compute[75288]:       <entry name="serial">ce476b0b-4ed7-42bc-9801-860255953006</entry>
Dec 01 13:51:49 user nova-compute[75288]:       <entry name="uuid">ce476b0b-4ed7-42bc-9801-860255953006</entry>
Dec 01 13:51:49 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:51:49 user nova-compute[75288]:     </system>
Dec 01 13:51:49 user nova-compute[75288]:   </sysinfo>
Dec 01 13:51:49 user nova-compute[75288]:   <os>
Dec 01 13:51:49 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:51:49 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:51:49 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:51:49 user nova-compute[75288]:   </os>
Dec 01 13:51:49 user nova-compute[75288]:   <features>
Dec 01 13:51:49 user nova-compute[75288]:     <acpi/>
Dec 01 13:51:49 user nova-compute[75288]:     <apic/>
Dec 01 13:51:49 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:51:49 user nova-compute[75288]:   </features>
Dec 01 13:51:49 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:51:49 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:51:49 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:51:49 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:51:49 user nova-compute[75288]:   </clock>
Dec 01 13:51:49 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:51:49 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:51:49 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:51:49 user nova-compute[75288]:   </cpu>
Dec 01 13:51:49 user nova-compute[75288]:   <devices>
Dec 01 13:51:49 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:51:49 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:51:49 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk"/>
Dec 01 13:51:49 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:51:49 user nova-compute[75288]:     </disk>
Dec 01 13:51:49 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:51:49 user nova-compute[75288]:       <mac address="fa:16:3e:97:73:e6"/>
Dec 01 13:51:49 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:51:49 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:51:49 user nova-compute[75288]:       <target dev="tapd2e3b708-7d"/>
Dec 01 13:51:49 user nova-compute[75288]:     </interface>
Dec 01 13:51:49 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:51:49 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/console.log" append="off"/>
Dec 01 13:51:49 user nova-compute[75288]:     </serial>
Dec 01 13:51:49 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:51:49 user nova-compute[75288]:     <video>
Dec 01 13:51:49 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:51:49 user nova-compute[75288]:     </video>
Dec 01 13:51:49 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:51:49 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:51:49 user nova-compute[75288]:     </rng>
Dec 01 13:51:49 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:51:49 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:51:49 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:51:49 user nova-compute[75288]:     </memballoon>
Dec 01 13:51:49 user nova-compute[75288]:   </devices>
Dec 01 13:51:49 user nova-compute[75288]: </domain>
Dec 01 13:51:49 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-898293798',display_name='tempest-ServerRescueNegativeTestJSON-server-898293798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-898293798',id=26,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc+Zizx0KU4YIgWRQ6wHDhgCZOBALQjYZgThcvzgaIFKNJWrmPvHt6TgjzBkijrHh+TxA9UV8Hc5NU4XjlSUVtH/24/aJnonQPBZEjENsXJ+40B6nhvTSZl28U4GD/svg==',key_name='tempest-keypair-1111385212',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-7310x4vc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad75165194843718ebc8b886ab3b6b7',uuid=ce476b0b-4ed7-42bc-9801-860255953006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=d2e3b708-7d4a-4339-880a-bfe8801dadc0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e3b708-7d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG os_vif [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=d2e3b708-7d4a-4339-880a-bfe8801dadc0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e3b708-7d') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bec5596f-4436-5f39-9109-e4e84c549bc5', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2e3b708-7d, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2e3b708-7d, col_values=(('qos', UUID('7e45ed85-df8b-4273-ac87-163e1f7ac44a')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2e3b708-7d, col_values=(('external_ids', {'iface-id': 'd2e3b708-7d4a-4339-880a-bfe8801dadc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:73:e6', 'vm-uuid': 'ce476b0b-4ed7-42bc-9801-860255953006'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:49 user nova-compute[75288]: INFO os_vif [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=d2e3b708-7d4a-4339-880a-bfe8801dadc0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e3b708-7d')
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No VIF found with MAC fa:16:3e:97:73:e6, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [{"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Releasing lock "refresh_cache-b6118993-49ad-4e01-8b70-e79eaf510b59" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7395227f-1af0-4097-a551-338ad53f005e tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "interface-b6118993-49ad-4e01-8b70-e79eaf510b59-b3321e01-4a80-47be-b8e3-bcc3dea4b62a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.514s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-7421b035-18a7-4762-8242-91e5b0367a95 req-d9521efc-6642-4256-8f36-c00be1d19a0a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updated VIF entry in instance network info cache for port d2e3b708-7d4a-4339-880a-bfe8801dadc0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-7421b035-18a7-4762-8242-91e5b0367a95 req-d9521efc-6642-4256-8f36-c00be1d19a0a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating instance_info_cache with network_info: [{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7421b035-18a7-4762-8242-91e5b0367a95 req-d9521efc-6642-4256-8f36-c00be1d19a0a service nova] Releasing lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:51:50 user nova-compute[75288]: INFO nova.compute.claims [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Claim successful on node user
Dec 01 13:51:50 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:51:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:51:51 user nova-compute[75288]: DEBUG nova.network.neutron [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:51:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:51:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:51:51 user nova-compute[75288]: INFO nova.virt.block_device [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Booting with blank volume at /dev/vda
Dec 01 13:51:51 user nova-compute[75288]: DEBUG nova.policy [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69266afe5e404e259d679d7498f99faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6b677b10d14d63984895b4cfbdad4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:51:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-8108f37e-66f4-41f1-9616-3b48c847233f req-d263e616-ee58-4daf-897c-fb61c99214d6 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8108f37e-66f4-41f1-9616-3b48c847233f req-d263e616-ee58-4daf-897c-fb61c99214d6 service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8108f37e-66f4-41f1-9616-3b48c847233f req-d263e616-ee58-4daf-897c-fb61c99214d6 service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8108f37e-66f4-41f1-9616-3b48c847233f req-d263e616-ee58-4daf-897c-fb61c99214d6 service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-8108f37e-66f4-41f1-9616-3b48c847233f req-d263e616-ee58-4daf-897c-fb61c99214d6 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:51 user nova-compute[75288]: WARNING nova.compute.manager [req-8108f37e-66f4-41f1-9616-3b48c847233f req-d263e616-ee58-4daf-897c-fb61c99214d6 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state building and task_state spawning.
Dec 01 13:51:51 user nova-compute[75288]: DEBUG nova.network.neutron [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Successfully created port: bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Successfully updated port: bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquired lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9178bdb0-61a8-4f20-a6c8-0c7b08bb7db4 req-fe3dfca5-1da1-4ae1-b7d1-02d5008107a8 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-changed-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9178bdb0-61a8-4f20-a6c8-0c7b08bb7db4 req-fe3dfca5-1da1-4ae1-b7d1-02d5008107a8 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Refreshing instance network info cache due to event network-changed-bf72b948-d727-4c36-af5f-57b0b21b2d4c. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9178bdb0-61a8-4f20-a6c8-0c7b08bb7db4 req-fe3dfca5-1da1-4ae1-b7d1-02d5008107a8 service nova] Acquiring lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:52 user nova-compute[75288]: DEBUG nova.network.neutron [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updating instance_info_cache with network_info: [{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Releasing lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance network_info: |[{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9178bdb0-61a8-4f20-a6c8-0c7b08bb7db4 req-fe3dfca5-1da1-4ae1-b7d1-02d5008107a8 service nova] Acquired lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-9178bdb0-61a8-4f20-a6c8-0c7b08bb7db4 req-fe3dfca5-1da1-4ae1-b7d1-02d5008107a8 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Refreshing network info cache for port bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b299dbb-fd4d-438d-b12c-05759a9b29f5 req-8eb66f8b-eec2-417f-8894-409e6e49ae39 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b299dbb-fd4d-438d-b12c-05759a9b29f5 req-8eb66f8b-eec2-417f-8894-409e6e49ae39 service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b299dbb-fd4d-438d-b12c-05759a9b29f5 req-8eb66f8b-eec2-417f-8894-409e6e49ae39 service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b299dbb-fd4d-438d-b12c-05759a9b29f5 req-8eb66f8b-eec2-417f-8894-409e6e49ae39 service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b299dbb-fd4d-438d-b12c-05759a9b29f5 req-8eb66f8b-eec2-417f-8894-409e6e49ae39 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:51:53 user nova-compute[75288]: WARNING nova.compute.manager [req-4b299dbb-fd4d-438d-b12c-05759a9b29f5 req-8eb66f8b-eec2-417f-8894-409e6e49ae39 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state building and task_state spawning.
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:51:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance spawned successfully.
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:51:53 user nova-compute[75288]: INFO nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Took 7.19 seconds to spawn the instance on the hypervisor.
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:51:53 user nova-compute[75288]: INFO nova.compute.manager [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Took 8.41 seconds to build instance.
Dec 01 13:51:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7e28c036-4e32-4cac-9537-2c9056f67696 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.599s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-9178bdb0-61a8-4f20-a6c8-0c7b08bb7db4 req-fe3dfca5-1da1-4ae1-b7d1-02d5008107a8 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updated VIF entry in instance network info cache for port bf72b948-d727-4c36-af5f-57b0b21b2d4c. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG nova.network.neutron [req-9178bdb0-61a8-4f20-a6c8-0c7b08bb7db4 req-fe3dfca5-1da1-4ae1-b7d1-02d5008107a8 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updating instance_info_cache with network_info: [{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9178bdb0-61a8-4f20-a6c8-0c7b08bb7db4 req-fe3dfca5-1da1-4ae1-b7d1-02d5008107a8 service nova] Releasing lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-3ea75c9d-a8c3-4c1c-b88c-f26421717016 req-9e5192f6-e91c-4b45-8aca-51f33f3ea8eb service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received event network-changed-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-3ea75c9d-a8c3-4c1c-b88c-f26421717016 req-9e5192f6-e91c-4b45-8aca-51f33f3ea8eb service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Refreshing instance network info cache due to event network-changed-6d8af2ea-8107-40d1-9f46-2610d8e3e026. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3ea75c9d-a8c3-4c1c-b88c-f26421717016 req-9e5192f6-e91c-4b45-8aca-51f33f3ea8eb service nova] Acquiring lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3ea75c9d-a8c3-4c1c-b88c-f26421717016 req-9e5192f6-e91c-4b45-8aca-51f33f3ea8eb service nova] Acquired lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-3ea75c9d-a8c3-4c1c-b88c-f26421717016 req-9e5192f6-e91c-4b45-8aca-51f33f3ea8eb service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Refreshing network info cache for port 6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:55 user nova-compute[75288]: INFO nova.compute.manager [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Detaching volume 0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:51:55 user nova-compute[75288]: INFO nova.virt.block_device [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Attempting to driver detach volume 0b2d4a57-112e-44c5-96bf-a5117bed88f5 from mountpoint /dev/vdb
Dec 01 13:51:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Attempting to detach device vdb from instance 64e25352-1ed2-4eda-a376-cb722f0b779f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:51:55 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:51:55 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:51:55 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:51:55 user nova-compute[75288]:   <serial>0b2d4a57-112e-44c5-96bf-a5117bed88f5</serial>
Dec 01 13:51:55 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 13:51:55 user nova-compute[75288]: </disk>
Dec 01 13:51:55 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:51:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully detached device vdb from instance 64e25352-1ed2-4eda-a376-cb722f0b779f from the persistent domain config.
Dec 01 13:51:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64e25352-1ed2-4eda-a376-cb722f0b779f from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:51:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:51:55 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:51:55 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:51:55 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:51:55 user nova-compute[75288]:   <serial>0b2d4a57-112e-44c5-96bf-a5117bed88f5</serial>
Dec 01 13:51:55 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 13:51:55 user nova-compute[75288]: </disk>
Dec 01 13:51:55 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-3ea75c9d-a8c3-4c1c-b88c-f26421717016 req-9e5192f6-e91c-4b45-8aca-51f33f3ea8eb service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updated VIF entry in instance network info cache for port 6d8af2ea-8107-40d1-9f46-2610d8e3e026. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-3ea75c9d-a8c3-4c1c-b88c-f26421717016 req-9e5192f6-e91c-4b45-8aca-51f33f3ea8eb service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updating instance_info_cache with network_info: [{"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3ea75c9d-a8c3-4c1c-b88c-f26421717016 req-9e5192f6-e91c-4b45-8aca-51f33f3ea8eb service nova] Releasing lock "refresh_cache-a429ddc9-a5d9-460a-aac1-e7a27d7861ae" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64e25352-1ed2-4eda-a376-cb722f0b779f {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lazy-loading 'flavor' on Instance uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:51:56 user nova-compute[75288]: INFO nova.compute.manager [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Attaching volume fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 to /dev/vdb
Dec 01 13:51:56 user nova-compute[75288]: DEBUG os_brick.utils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb813ee-55e4-4888-b182-bbec46c261df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d5315b-2901-499b-ac5a-7c8051350884]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e2781b-c847-462e-84d8-011d0f5dbaa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[013334af-0602-4aff-a980-e2e8e7df59e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:51:57 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440c9fb-870c-4c51-86b6-f0c8957e055e]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.utils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updating existing volume attachment record: c84b4805-539d-4f4d-9414-bb69323e2124 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.utils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cccfcb-3f76-4f26-9817-7667d0e4536e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ef0a70-ddc5-4876-bc1a-30c49a8c28c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0570755d-be46-4c58-bad5-d166a7e210a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[098252d6-e4d4-4363-9299-09e18da8dc31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:51:57 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:51:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db5cba1-a732-4331-b4d3-b402afaf4276]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG os_brick.utils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:51:57 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updating existing volume attachment record: 6d19d4b1-62b9-40e3-89e8-8ece03118d47 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:51:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:52:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Creating image(s)
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Ensure instance console log exists: /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Start _get_guest_xml network_info=[{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6d19d4b1-62b9-40e3-89e8-8ece03118d47', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekPXMDlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e38d99ed-efd9-4222-aaae-b06934bfac06', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'serial': 'fc17edfe-3a58-4536-bcc4-9419c41d4f2f'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:52:13 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:52:13 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekPXMDlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:52:13 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:52:13 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:52:13 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5507ea55-5ab9-42fc-ba1c-6131e99838b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:52:13 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d9b5b-43fb-44b4-90a9-b9cd649fea73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f] added
Dec 01 13:52:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9108f01-00d1-4431-8c90-f7bf597aadfa]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b93ce9e-8bcd-42f7-983f-f2352c37d96b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekPXMDlg {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekPXMDlg" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b9e201-0f66-41e2-849b-352ce8a449b6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ekPXMDlg'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7749c228-57a5-43bd-84e9-c4e7edf0f82c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c6a60-a53c-41f4-8e7e-34d7230d6312]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:13 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:13 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0f0aed-d72c-46d5-a76a-7cf75721eb25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f, portal: 172.16.0.220,3260]
Dec 01 13:52:13 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f, portal: 172.16.0.220,3260] successful.
Dec 01 13:52:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[87972190-478d-439f-ae86-169fbb7548a6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f90151-fd4d-4f35-9d65-674a11ed429e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:14 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:14 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:14 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:14 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[17235301-2e99-4d5e-aaa2-a2e47cb85c01]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekPXMDlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbrZHKNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:52:14 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:52:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.509s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '26133366535643162', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133366535643162', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.073s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:52:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:52:15 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:52:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=25.27300262451172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a5c1cd-f490-4699-8609-d8285cd1d2bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:52:15 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-869445862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-869445862',id=27,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-bou0lhif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:51:51Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=e38d99ed-efd9-4222-aaae-b06934bfac06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:44:61,bridge_name='br-int',has_traffic_filtering=True,id=bf72b948-d727-4c36-af5f-57b0b21b2d4c,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf72b948-d7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.objects.instance [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'pci_devices' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf5f367-c8eb-4497-a0eb-c030543f461f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494] added
Dec 01 13:52:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:52:15 user nova-compute[75288]:   <uuid>e38d99ed-efd9-4222-aaae-b06934bfac06</uuid>
Dec 01 13:52:15 user nova-compute[75288]:   <name>instance-0000001b</name>
Dec 01 13:52:15 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:52:15 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:52:15 user nova-compute[75288]:   <metadata>
Dec 01 13:52:15 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:52:15 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:52:15 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-869445862</nova:name>
Dec 01 13:52:15 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:52:13</nova:creationTime>
Dec 01 13:52:15 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:52:15 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:52:15 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:52:15 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:52:15 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:52:15 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:52:15 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:52:15 user nova-compute[75288]:       <nova:owner>
Dec 01 13:52:15 user nova-compute[75288]:         <nova:user uuid="69266afe5e404e259d679d7498f99faa">tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member</nova:user>
Dec 01 13:52:15 user nova-compute[75288]:         <nova:project uuid="2e6b677b10d14d63984895b4cfbdad4b">tempest-ServerBootFromVolumeStableRescueTest-64531845</nova:project>
Dec 01 13:52:15 user nova-compute[75288]:       </nova:owner>
Dec 01 13:52:15 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:52:15 user nova-compute[75288]:       <nova:ports>
Dec 01 13:52:15 user nova-compute[75288]:         <nova:port uuid="bf72b948-d727-4c36-af5f-57b0b21b2d4c">
Dec 01 13:52:15 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:52:15 user nova-compute[75288]:         </nova:port>
Dec 01 13:52:15 user nova-compute[75288]:       </nova:ports>
Dec 01 13:52:15 user nova-compute[75288]:     </nova:instance>
Dec 01 13:52:15 user nova-compute[75288]:   </metadata>
Dec 01 13:52:15 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:52:15 user nova-compute[75288]:     <system>
Dec 01 13:52:15 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:52:15 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:52:15 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:52:15 user nova-compute[75288]:       <entry name="serial">e38d99ed-efd9-4222-aaae-b06934bfac06</entry>
Dec 01 13:52:15 user nova-compute[75288]:       <entry name="uuid">e38d99ed-efd9-4222-aaae-b06934bfac06</entry>
Dec 01 13:52:15 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:52:15 user nova-compute[75288]:     </system>
Dec 01 13:52:15 user nova-compute[75288]:   </sysinfo>
Dec 01 13:52:15 user nova-compute[75288]:   <os>
Dec 01 13:52:15 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:52:15 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:52:15 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:52:15 user nova-compute[75288]:   </os>
Dec 01 13:52:15 user nova-compute[75288]:   <features>
Dec 01 13:52:15 user nova-compute[75288]:     <acpi/>
Dec 01 13:52:15 user nova-compute[75288]:     <apic/>
Dec 01 13:52:15 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:52:15 user nova-compute[75288]:   </features>
Dec 01 13:52:15 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:52:15 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:52:15 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:52:15 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:52:15 user nova-compute[75288]:   </clock>
Dec 01 13:52:15 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:52:15 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:52:15 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:52:15 user nova-compute[75288]:   </cpu>
Dec 01 13:52:15 user nova-compute[75288]:   <devices>
Dec 01 13:52:15 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:52:15 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:52:15 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Dec 01 13:52:15 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:52:15 user nova-compute[75288]:       <serial>fc17edfe-3a58-4536-bcc4-9419c41d4f2f</serial>
Dec 01 13:52:15 user nova-compute[75288]:     </disk>
Dec 01 13:52:15 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:52:15 user nova-compute[75288]:       <mac address="fa:16:3e:45:44:61"/>
Dec 01 13:52:15 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:52:15 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:52:15 user nova-compute[75288]:       <target dev="tapbf72b948-d7"/>
Dec 01 13:52:15 user nova-compute[75288]:     </interface>
Dec 01 13:52:15 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:52:15 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/console.log" append="off"/>
Dec 01 13:52:15 user nova-compute[75288]:     </serial>
Dec 01 13:52:15 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:52:15 user nova-compute[75288]:     <video>
Dec 01 13:52:15 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:52:15 user nova-compute[75288]:     </video>
Dec 01 13:52:15 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:52:15 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:52:15 user nova-compute[75288]:     </rng>
Dec 01 13:52:15 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:52:15 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:52:15 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:52:15 user nova-compute[75288]:     </memballoon>
Dec 01 13:52:15 user nova-compute[75288]:   </devices>
Dec 01 13:52:15 user nova-compute[75288]: </domain>
Dec 01 13:52:15 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-869445862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-869445862',id=27,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-bou0lhif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:51:51Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=e38d99ed-efd9-4222-aaae-b06934bfac06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:44:61,bridge_name='br-int',has_traffic_filtering=True,id=bf72b948-d727-4c36-af5f-57b0b21b2d4c,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf72b948-d7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_vif [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:44:61,bridge_name='br-int',has_traffic_filtering=True,id=bf72b948-d727-4c36-af5f-57b0b21b2d4c,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf72b948-d7') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f331891-0a0e-58a4-a6ed-b0b3be679f51', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8884b27-26ed-4f1c-b9c8-b5e799040c52]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf72b948-d7, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf72b948-d7, col_values=(('qos', UUID('70654219-541a-46a0-8331-ecadc2d878b3')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf72b948-d7, col_values=(('external_ids', {'iface-id': 'bf72b948-d727-4c36-af5f-57b0b21b2d4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:44:61', 'vm-uuid': 'e38d99ed-efd9-4222-aaae-b06934bfac06'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.069s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b5542c-8b11-4613-b540-ccb8d8afaa48]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:15 user nova-compute[75288]: INFO os_vif [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:44:61,bridge_name='br-int',has_traffic_filtering=True,id=bf72b948-d727-4c36-af5f-57b0b21b2d4c,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf72b948-d7')
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbrZHKNw {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 64e25352-1ed2-4eda-a376-cb722f0b779f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b6118993-49ad-4e01-8b70-e79eaf510b59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ce476b0b-4ed7-42bc-9801-860255953006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kbrZHKNw" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6821839-4634-4c4d-ae12-cd6c5fdf976e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kbrZHKNw'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No VIF found with MAC fa:16:3e:45:44:61, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e26355-15cf-47d9-904f-fc170ef9a006]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1838bc-9e55-4e22-b7f1-c13f278712ec]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb77dde-007c-4b3a-aa57-30c9c2064ae7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494, portal: 172.16.0.220,3260]
Dec 01 13:52:15 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494, portal: 172.16.0.220,3260] successful.
Dec 01 13:52:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a1f786-b569-4775-b9c0-9eefcfe2723a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec617a7-0a19-44ef-ad8d-55d969b4b109]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:15 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[664a18a9-560f-4000-95ab-3f1b2fde93d0]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:52:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:52:16 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64e25352-1ed2-4eda-a376-cb722f0b779f is timed out.
Dec 01 13:52:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully detached device vdb from instance 64e25352-1ed2-4eda-a376-cb722f0b779f from the live domain config.
Dec 01 13:52:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mUyoteZE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:52:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbrZHKNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] <== connect_volume: return (2545ms) {'type': 'block', 'scsi_wwn': '23539323836373333', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539323836373333', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.219s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lazy-loading 'flavor' on Instance uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c8ef4f-36f4-422b-90aa-d678c4a39ca4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:52:16 user nova-compute[75288]: No targets found.
Dec 01 13:52:16 user nova-compute[75288]: iSNS:
Dec 01 13:52:16 user nova-compute[75288]: No targets found.
Dec 01 13:52:16 user nova-compute[75288]: STATIC:
Dec 01 13:52:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:52:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:52:16 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:52:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494
Dec 01 13:52:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:52:16 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:52:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5
Dec 01 13:52:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:52:16 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:52:16 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:52:16 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:52:16 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:52:16 user nova-compute[75288]: FIRMWARE:
Dec 01 13:52:16 user nova-compute[75288]: No targets found.
Dec 01 13:52:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:52:16 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:52:16 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4180a5aa-d1af-4101-8373-73a7be72df3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:52:16 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:52:16 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:52:16 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:52:16 user nova-compute[75288]:   <serial>fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494</serial>
Dec 01 13:52:16 user nova-compute[75288]: </disk>
Dec 01 13:52:16 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71b18b4-a4ed-4600-9be8-bbb69be37b1d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:16 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:16 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:16 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 (non-flash)
Dec 01 13:52:16 user nova-compute[75288]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:16 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:16 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc6923b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c7908a-42af-4967-90d0-9786bb5c5070]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.036s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3315eb-6c50-4f8f-a6be-300ae90b9946]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[073298a0-ed53-4815-a44a-97fd4b083736]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c77cd54-a4fd-4f9c-9543-05867482494f]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b8f984-f71f-4461-b113-3453b502bbe7]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[39841d1c-4e00-4559-a3e5-3a03ed1f63ad]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260]
Dec 01 13:52:17 user nova-compute[75288]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5, portal: 172.16.0.220,3260] successful.
Dec 01 13:52:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2d4a57-112e-44c5-96bf-a5117bed88f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e5be87-8f04-4544-b346-cf635889fd08]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== disconnect_volume: return (604ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-cb03fd6f-ae55-442c-bf42-3e5412967ba5 req-f79b32ba-508c-4d1b-861f-c077f3dafe59 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb03fd6f-ae55-442c-bf42-3e5412967ba5 req-f79b32ba-508c-4d1b-861f-c077f3dafe59 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb03fd6f-ae55-442c-bf42-3e5412967ba5 req-f79b32ba-508c-4d1b-861f-c077f3dafe59 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cb03fd6f-ae55-442c-bf42-3e5412967ba5 req-f79b32ba-508c-4d1b-861f-c077f3dafe59 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-cb03fd6f-ae55-442c-bf42-3e5412967ba5 req-f79b32ba-508c-4d1b-861f-c077f3dafe59 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:52:17 user nova-compute[75288]: WARNING nova.compute.manager [req-cb03fd6f-ae55-442c-bf42-3e5412967ba5 req-f79b32ba-508c-4d1b-861f-c077f3dafe59 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state building and task_state spawning.
Dec 01 13:52:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No VIF found with MAC fa:16:3e:81:fd:79, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:52:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3a38fc98-eced-4368-83a2-b91e55cd0456 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.691s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'flavor' on Instance uuid 64e25352-1ed2-4eda-a376-cb722f0b779f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5958c14f-5196-4ae1-84e1-f1a6dacb091b tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.526s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:18 user nova-compute[75288]: INFO nova.compute.manager [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Terminating instance
Dec 01 13:52:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:52:19 user nova-compute[75288]: WARNING nova.compute.manager [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state building and task_state spawning.
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-unplugged-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] No waiting events found dispatching network-vif-unplugged-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.compute.manager [req-b0697b47-047a-43ac-80ae-c2af7f3621d7 req-031c8053-a8fe-40be-91ce-f03f7fc555c2 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-unplugged-149cf680-382c-459a-873b-fb777184f080 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:52:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Instance destroyed successfully.
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lazy-loading 'resources' on Instance uuid b6118993-49ad-4e01-8b70-e79eaf510b59 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T13:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1037148651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1037148651',id=21,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8kV3xl6jFd6NeahPnTPvsYjFMhdtXGSPM4eicBoNlQGo2i/FazpMsrjOANlM9IoEVZlrlPs6Nw1vJmr2fb5KBPZvo5EDV+0ilgNEBb7RindjKAwLjjfPWSYZJPeU4oUw==',key_name='tempest-keypair-664200373',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f7111fdc7a44f539b3c53ac5c7b4961',ramdisk_id='',reservation_id='r-uvrpbmvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-799909704',owner_user_name='tempest-TaggedAttachmentsTest-799909704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3da01fd9ed04c2984868b13e38d3983',uuid=b6118993-49ad-4e01-8b70-e79eaf510b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converting VIF {"id": "149cf680-382c-459a-873b-fb777184f080", "address": "fa:16:3e:b5:77:ab", "network": {"id": "dcc40867-00ab-464e-86ef-2d0a99594cc7", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1268114146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f7111fdc7a44f539b3c53ac5c7b4961", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap149cf680-38", "ovs_interfaceid": "149cf680-382c-459a-873b-fb777184f080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:77:ab,bridge_name='br-int',has_traffic_filtering=True,id=149cf680-382c-459a-873b-fb777184f080,network=Network(dcc40867-00ab-464e-86ef-2d0a99594cc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149cf680-38') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG os_vif [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:77:ab,bridge_name='br-int',has_traffic_filtering=True,id=149cf680-382c-459a-873b-fb777184f080,network=Network(dcc40867-00ab-464e-86ef-2d0a99594cc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149cf680-38') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap149cf680-38, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92a80fc5-c93c-4c25-8132-9fe4932c84ad) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance spawned successfully.
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:52:19 user nova-compute[75288]: INFO os_vif [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:77:ab,bridge_name='br-int',has_traffic_filtering=True,id=149cf680-382c-459a-873b-fb777184f080,network=Network(dcc40867-00ab-464e-86ef-2d0a99594cc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap149cf680-38')
Dec 01 13:52:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Deleting instance files /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59_del
Dec 01 13:52:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Deletion of /opt/stack/data/nova/instances/b6118993-49ad-4e01-8b70-e79eaf510b59_del complete
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:19 user nova-compute[75288]: INFO nova.compute.manager [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Took 1.11 seconds to destroy the instance on the hypervisor.
Dec 01 13:52:19 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:52:19 user nova-compute[75288]: INFO nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Took 6.34 seconds to spawn the instance on the hypervisor.
Dec 01 13:52:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:52:20 user nova-compute[75288]: INFO nova.compute.manager [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Took 29.61 seconds to build instance.
Dec 01 13:52:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-20f57454-29ec-4fa8-8cdf-53a3957ad52c tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.731s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:20 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:52:20 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Took 1.00 seconds to deallocate network for instance.
Dec 01 13:52:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-e011c43c-14e9-4872-9506-f1405a65ca40 req-f218b370-bc24-43af-b9f2-c01139c22809 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-deleted-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:20 user nova-compute[75288]: INFO nova.compute.manager [req-e011c43c-14e9-4872-9506-f1405a65ca40 req-f218b370-bc24-43af-b9f2-c01139c22809 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Neutron deleted interface 149cf680-382c-459a-873b-fb777184f080; detaching it from the instance and deleting it from the info cache
Dec 01 13:52:20 user nova-compute[75288]: DEBUG nova.network.neutron [req-e011c43c-14e9-4872-9506-f1405a65ca40 req-f218b370-bc24-43af-b9f2-c01139c22809 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:52:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-e011c43c-14e9-4872-9506-f1405a65ca40 req-f218b370-bc24-43af-b9f2-c01139c22809 service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Detach interface failed, port_id=149cf680-382c-459a-873b-fb777184f080, reason: Instance b6118993-49ad-4e01-8b70-e79eaf510b59 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:52:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-fcdc524e-12b5-4864-ade7-7942ceff6c88 req-3a69743d-82f4-408e-8598-823f58bab24f service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received event network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fcdc524e-12b5-4864-ade7-7942ceff6c88 req-3a69743d-82f4-408e-8598-823f58bab24f service nova] Acquiring lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fcdc524e-12b5-4864-ade7-7942ceff6c88 req-3a69743d-82f4-408e-8598-823f58bab24f service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fcdc524e-12b5-4864-ade7-7942ceff6c88 req-3a69743d-82f4-408e-8598-823f58bab24f service nova] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-fcdc524e-12b5-4864-ade7-7942ceff6c88 req-3a69743d-82f4-408e-8598-823f58bab24f service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] No waiting events found dispatching network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:52:21 user nova-compute[75288]: WARNING nova.compute.manager [req-fcdc524e-12b5-4864-ade7-7942ceff6c88 req-3a69743d-82f4-408e-8598-823f58bab24f service nova] [instance: b6118993-49ad-4e01-8b70-e79eaf510b59] Received unexpected event network-vif-plugged-149cf680-382c-459a-873b-fb777184f080 for instance with vm_state deleted and task_state None.
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lazy-loading 'flavor' on Instance uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:21 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Deleted allocations for instance b6118993-49ad-4e01-8b70-e79eaf510b59
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:21 user nova-compute[75288]: INFO nova.compute.manager [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Attaching volume 8c906767-a6e3-40aa-bbbc-b67043bc7763 to /dev/vdc
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2363092a-03d2-45fc-a66b-a9dc0c364d8d tempest-TaggedAttachmentsTest-799909704 tempest-TaggedAttachmentsTest-799909704-project-member] Lock "b6118993-49ad-4e01-8b70-e79eaf510b59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.836s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG os_brick.utils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c69c5-b95f-4199-8ed2-be1f2589c80c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef1381d-d32b-48fd-8733-f7af797e625d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa9f2a-ac55-4777-bd6f-fe4ae637673e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[09235370-e4d7-453c-b8e8-d6c962427d28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:52:21 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:52:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f89738-e197-4d93-a80f-36a0747b3ecb]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG os_brick.utils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:52:21 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updating existing volume attachment record: e38797ac-9032-45e9-ab46-9dd960939bf2 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:52:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKkLPrlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:52:31 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:52:31 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:52:31 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ae5654-1095-4327-9ab0-3ab6d076b1ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:52:31 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6858eccf-2c87-455e-a1f6-5fe858d9c948]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763] added
Dec 01 13:52:31 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f254976c-2c4a-4730-8057-5aa7bd217742]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[30866e07-32cf-4c3e-a131-61a0d7b3c516]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKkLPrlO {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKkLPrlO" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f345a4de-6a23-46b4-a0aa-3bd8c2c65b08]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKkLPrlO'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde196a6-c4f8-45ab-8df8-e30f79450bd6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7103406c-549a-457f-aae8-cdaa2f24ecdd]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699bb36d-b833-4c14-bb2f-2a909f05aabb (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699bb36d-b833-4c14-bb2f-2a909f05aabb (non-flash)
Dec 01 13:52:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699bb36d-b833-4c14-bb2f-2a909f05aabb (non-flash)
Dec 01 13:52:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c8717f-d00f-4a4d-a7f6-5f831ae428a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763, portal: 172.16.0.220,3260]
Dec 01 13:52:32 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763, portal: 172.16.0.220,3260] successful.
Dec 01 13:52:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d510f08-5c3a-4b14-b887-057fddfc674b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9428f806-066c-4820-a1d9-92a50e5d28d0]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699bb36d-b833-4c14-bb2f-2a909f05aabb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699bb36d-b833-4c14-bb2f-2a909f05aabb (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:699bb36d-b833-4c14-bb2f-2a909f05aabb (non-flash)
Dec 01 13:52:32 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 (non-flash)
Dec 01 13:52:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f39352-85e5-467b-9693-b6350a4c16a1]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:32 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKkLPrlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23134373430366533', 'path': '/dev/sdf'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373430366533', 'path': '/dev/sdf'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lazy-loading 'flavor' on Instance uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:52:33 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:52:33 user nova-compute[75288]:   <source dev="/dev/sdf"/>
Dec 01 13:52:33 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Dec 01 13:52:33 user nova-compute[75288]:   <serial>8c906767-a6e3-40aa-bbbc-b67043bc7763</serial>
Dec 01 13:52:33 user nova-compute[75288]: </disk>
Dec 01 13:52:33 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] No VIF found with MAC fa:16:3e:81:fd:79, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:52:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8fc049e-db4c-450a-bf8f-5444f8c0aa61 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.245s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:34 user nova-compute[75288]: INFO nova.compute.manager [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Detaching volume 8c906767-a6e3-40aa-bbbc-b67043bc7763
Dec 01 13:52:34 user nova-compute[75288]: INFO nova.virt.block_device [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Attempting to driver detach volume 8c906767-a6e3-40aa-bbbc-b67043bc7763 from mountpoint /dev/vdc
Dec 01 13:52:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Attempting to detach device vdc from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:52:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:52:34 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:52:34 user nova-compute[75288]:   <source dev="/dev/sdf"/>
Dec 01 13:52:34 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Dec 01 13:52:34 user nova-compute[75288]:   <serial>8c906767-a6e3-40aa-bbbc-b67043bc7763</serial>
Dec 01 13:52:34 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 13:52:34 user nova-compute[75288]: </disk>
Dec 01 13:52:34 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:52:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Successfully detached device vdc from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae from the persistent domain config.
Dec 01 13:52:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:52:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:52:35 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:52:35 user nova-compute[75288]:   <source dev="/dev/sdf"/>
Dec 01 13:52:35 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Dec 01 13:52:35 user nova-compute[75288]:   <serial>8c906767-a6e3-40aa-bbbc-b67043bc7763</serial>
Dec 01 13:52:35 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 13:52:35 user nova-compute[75288]: </disk>
Dec 01 13:52:35 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:52:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:52:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:52:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:52:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:52:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:52:44 user nova-compute[75288]: INFO nova.compute.claims [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Claim successful on node user
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:52:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.policy [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e299489ce6ea49ba9fd3bd83a44002c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51003ff129d43df8b28f33bae48350c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:52:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Creating image(s)
Dec 01 13:52:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "/opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "/opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "/opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.339s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:46 user nova-compute[75288]: INFO nova.compute.manager [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Terminating instance
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.263s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk 1073741824" returned: 0 in 0.090s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Successfully created port: 9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-afde0b08-9db6-43a6-b1f3-8513e1f55969 req-3b592365-38bd-4a19-aa26-dde06ae79135 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-unplugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-afde0b08-9db6-43a6-b1f3-8513e1f55969 req-3b592365-38bd-4a19-aa26-dde06ae79135 service nova] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-afde0b08-9db6-43a6-b1f3-8513e1f55969 req-3b592365-38bd-4a19-aa26-dde06ae79135 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-afde0b08-9db6-43a6-b1f3-8513e1f55969 req-3b592365-38bd-4a19-aa26-dde06ae79135 service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-afde0b08-9db6-43a6-b1f3-8513e1f55969 req-3b592365-38bd-4a19-aa26-dde06ae79135 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] No waiting events found dispatching network-vif-unplugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-afde0b08-9db6-43a6-b1f3-8513e1f55969 req-3b592365-38bd-4a19-aa26-dde06ae79135 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-unplugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Cannot resize image /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Ensure instance console log exists: /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Instance destroyed successfully.
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'resources' on Instance uuid 64e25352-1ed2-4eda-a376-cb722f0b779f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T13:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-40793095',display_name='tempest-ServerActionsTestOtherA-server-1793427622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-40793095',id=15,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5j1QWrZjfkoFlcpgSGfDNOjKE6v1FOAOHJWIKiXDL1au5SABv0JByEfrULtJD5kv5INUeHAkqa5529ZSiBuaqcnIji8lw7kE1ULzkmLZbtPCUiT9YmupohdcUvXOM8jA==',key_name='tempest-keypair-546973573',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-s007j6g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=64e25352-1ed2-4eda-a376-cb722f0b779f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "address": "fa:16:3e:80:8b:d4", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333c0000-ff", "ovs_interfaceid": "333c0000-ff58-4863-9d8e-0ddb10c68fd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG os_vif [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap333c0000-ff, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7faf36a4-4dfa-4e37-8d2e-a07cd0956edf) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:52:47 user nova-compute[75288]: INFO os_vif [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:8b:d4,bridge_name='br-int',has_traffic_filtering=True,id=333c0000-ff58-4863-9d8e-0ddb10c68fd4,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333c0000-ff')
Dec 01 13:52:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Deleting instance files /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f_del
Dec 01 13:52:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Deletion of /opt/stack/data/nova/instances/64e25352-1ed2-4eda-a376-cb722f0b779f_del complete
Dec 01 13:52:47 user nova-compute[75288]: INFO nova.compute.manager [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Took 0.97 seconds to destroy the instance on the hypervisor.
Dec 01 13:52:47 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Successfully updated port: 9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "refresh_cache-0643ed1e-37b9-4a4b-b260-c9dc602190ab" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquired lock "refresh_cache-0643ed1e-37b9-4a4b-b260-c9dc602190ab" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:52:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Updating instance_info_cache with network_info: [{"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-12e3a5f5-cec2-47ef-9ca9-142c47db995b req-625aaa01-f934-434a-8984-47f6a2f6e468 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-deleted-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:48 user nova-compute[75288]: INFO nova.compute.manager [req-12e3a5f5-cec2-47ef-9ca9-142c47db995b req-625aaa01-f934-434a-8984-47f6a2f6e468 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Neutron deleted interface 333c0000-ff58-4863-9d8e-0ddb10c68fd4; detaching it from the instance and deleting it from the info cache
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-12e3a5f5-cec2-47ef-9ca9-142c47db995b req-625aaa01-f934-434a-8984-47f6a2f6e468 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:52:48 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Took 0.98 seconds to deallocate network for instance.
Dec 01 13:52:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Releasing lock "refresh_cache-0643ed1e-37b9-4a4b-b260-c9dc602190ab" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Instance network_info: |[{"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Start _get_guest_xml network_info=[{"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-12e3a5f5-cec2-47ef-9ca9-142c47db995b req-625aaa01-f934-434a-8984-47f6a2f6e468 service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Detach interface failed, port_id=333c0000-ff58-4863-9d8e-0ddb10c68fd4, reason: Instance 64e25352-1ed2-4eda-a376-cb722f0b779f could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:52:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:52:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-593156575',display_name='tempest-ServersNegativeTestJSON-server-593156575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-593156575',id=28,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d51003ff129d43df8b28f33bae48350c',ramdisk_id='',reservation_id='r-qd0m7wju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1610504678',owner_user_name='tempest-ServersNegativeTestJSON-1610504678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:52:45Z,user_data=None,user_id='e299489ce6ea49ba9fd3bd83a44002c4',uuid=0643ed1e-37b9-4a4b-b260-c9dc602190ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converting VIF {"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:3d:97,bridge_name='br-int',has_traffic_filtering=True,id=9cd3ac39-ea4d-478d-a403-a77ee9e8296b,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd3ac39-ea') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lazy-loading 'pci_devices' on Instance uuid 0643ed1e-37b9-4a4b-b260-c9dc602190ab {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:52:48 user nova-compute[75288]:   <uuid>0643ed1e-37b9-4a4b-b260-c9dc602190ab</uuid>
Dec 01 13:52:48 user nova-compute[75288]:   <name>instance-0000001c</name>
Dec 01 13:52:48 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:52:48 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:52:48 user nova-compute[75288]:   <metadata>
Dec 01 13:52:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:52:48 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:52:48 user nova-compute[75288]:       <nova:name>tempest-ServersNegativeTestJSON-server-593156575</nova:name>
Dec 01 13:52:48 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:52:48</nova:creationTime>
Dec 01 13:52:48 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:52:48 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:52:48 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:52:48 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:52:48 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:52:48 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:52:48 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:52:48 user nova-compute[75288]:       <nova:owner>
Dec 01 13:52:48 user nova-compute[75288]:         <nova:user uuid="e299489ce6ea49ba9fd3bd83a44002c4">tempest-ServersNegativeTestJSON-1610504678-project-member</nova:user>
Dec 01 13:52:48 user nova-compute[75288]:         <nova:project uuid="d51003ff129d43df8b28f33bae48350c">tempest-ServersNegativeTestJSON-1610504678</nova:project>
Dec 01 13:52:48 user nova-compute[75288]:       </nova:owner>
Dec 01 13:52:48 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:52:48 user nova-compute[75288]:       <nova:ports>
Dec 01 13:52:48 user nova-compute[75288]:         <nova:port uuid="9cd3ac39-ea4d-478d-a403-a77ee9e8296b">
Dec 01 13:52:48 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 13:52:48 user nova-compute[75288]:         </nova:port>
Dec 01 13:52:48 user nova-compute[75288]:       </nova:ports>
Dec 01 13:52:48 user nova-compute[75288]:     </nova:instance>
Dec 01 13:52:48 user nova-compute[75288]:   </metadata>
Dec 01 13:52:48 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:52:48 user nova-compute[75288]:     <system>
Dec 01 13:52:48 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:52:48 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:52:48 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:52:48 user nova-compute[75288]:       <entry name="serial">0643ed1e-37b9-4a4b-b260-c9dc602190ab</entry>
Dec 01 13:52:48 user nova-compute[75288]:       <entry name="uuid">0643ed1e-37b9-4a4b-b260-c9dc602190ab</entry>
Dec 01 13:52:48 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:52:48 user nova-compute[75288]:     </system>
Dec 01 13:52:48 user nova-compute[75288]:   </sysinfo>
Dec 01 13:52:48 user nova-compute[75288]:   <os>
Dec 01 13:52:48 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:52:48 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:52:48 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:52:48 user nova-compute[75288]:   </os>
Dec 01 13:52:48 user nova-compute[75288]:   <features>
Dec 01 13:52:48 user nova-compute[75288]:     <acpi/>
Dec 01 13:52:48 user nova-compute[75288]:     <apic/>
Dec 01 13:52:48 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:52:48 user nova-compute[75288]:   </features>
Dec 01 13:52:48 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:52:48 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:52:48 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:52:48 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:52:48 user nova-compute[75288]:   </clock>
Dec 01 13:52:48 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:52:48 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:52:48 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:52:48 user nova-compute[75288]:   </cpu>
Dec 01 13:52:48 user nova-compute[75288]:   <devices>
Dec 01 13:52:48 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:52:48 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:52:48 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk"/>
Dec 01 13:52:48 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:52:48 user nova-compute[75288]:     </disk>
Dec 01 13:52:48 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:52:48 user nova-compute[75288]:       <mac address="fa:16:3e:b4:3d:97"/>
Dec 01 13:52:48 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:52:48 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:52:48 user nova-compute[75288]:       <target dev="tap9cd3ac39-ea"/>
Dec 01 13:52:48 user nova-compute[75288]:     </interface>
Dec 01 13:52:48 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:52:48 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/console.log" append="off"/>
Dec 01 13:52:48 user nova-compute[75288]:     </serial>
Dec 01 13:52:48 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:52:48 user nova-compute[75288]:     <video>
Dec 01 13:52:48 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:52:48 user nova-compute[75288]:     </video>
Dec 01 13:52:48 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:52:48 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:52:48 user nova-compute[75288]:     </rng>
Dec 01 13:52:48 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:52:48 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:52:48 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:52:48 user nova-compute[75288]:     </memballoon>
Dec 01 13:52:48 user nova-compute[75288]:   </devices>
Dec 01 13:52:48 user nova-compute[75288]: </domain>
Dec 01 13:52:48 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-593156575',display_name='tempest-ServersNegativeTestJSON-server-593156575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-593156575',id=28,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d51003ff129d43df8b28f33bae48350c',ramdisk_id='',reservation_id='r-qd0m7wju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1610504678',owner_user_name='tempest-ServersNegativeTestJSON-1610504678-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:52:45Z,user_data=None,user_id='e299489ce6ea49ba9fd3bd83a44002c4',uuid=0643ed1e-37b9-4a4b-b260-c9dc602190ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converting VIF {"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:3d:97,bridge_name='br-int',has_traffic_filtering=True,id=9cd3ac39-ea4d-478d-a403-a77ee9e8296b,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd3ac39-ea') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG os_vif [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:3d:97,bridge_name='br-int',has_traffic_filtering=True,id=9cd3ac39-ea4d-478d-a403-a77ee9e8296b,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd3ac39-ea') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68653154-e5e6-5324-9615-a360bafcbfaa', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cd3ac39-ea, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cd3ac39-ea, col_values=(('qos', UUID('4cb77fdc-fa72-4dc7-9865-7fcab9d974f9')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cd3ac39-ea, col_values=(('external_ids', {'iface-id': '9cd3ac39-ea4d-478d-a403-a77ee9e8296b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:3d:97', 'vm-uuid': '0643ed1e-37b9-4a4b-b260-c9dc602190ab'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:48 user nova-compute[75288]: INFO os_vif [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:3d:97,bridge_name='br-int',has_traffic_filtering=True,id=9cd3ac39-ea4d-478d-a403-a77ee9e8296b,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd3ac39-ea')
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] No VIF found with MAC fa:16:3e:b4:3d:97, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:52:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:48 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Deleted allocations for instance 64e25352-1ed2-4eda-a376-cb722f0b779f
Dec 01 13:52:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] Acquiring lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] No waiting events found dispatching network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:52:49 user nova-compute[75288]: WARNING nova.compute.manager [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] [instance: 64e25352-1ed2-4eda-a376-cb722f0b779f] Received unexpected event network-vif-plugged-333c0000-ff58-4863-9d8e-0ddb10c68fd4 for instance with vm_state deleted and task_state None.
Dec 01 13:52:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received event network-changed-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Refreshing instance network info cache due to event network-changed-9cd3ac39-ea4d-478d-a403-a77ee9e8296b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] Acquiring lock "refresh_cache-0643ed1e-37b9-4a4b-b260-c9dc602190ab" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] Acquired lock "refresh_cache-0643ed1e-37b9-4a4b-b260-c9dc602190ab" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Refreshing network info cache for port 9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e2be631-4754-4940-9657-29c1a8356d3e tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "64e25352-1ed2-4eda-a376-cb722f0b779f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.769s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Updated VIF entry in instance network info cache for port 9cd3ac39-ea4d-478d-a403-a77ee9e8296b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Updating instance_info_cache with network_info: [{"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f12589d5-f044-401f-9483-72860b07547a req-b92ba034-8113-4f85-a4a3-57ffb406d84e service nova] Releasing lock "refresh_cache-0643ed1e-37b9-4a4b-b260-c9dc602190ab" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-b99d91e9-088f-48fe-9a9d-f7d8a2e01241 req-f6b8d1f2-f325-4b2f-b9e4-7bb137735f08 service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received event network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b99d91e9-088f-48fe-9a9d-f7d8a2e01241 req-f6b8d1f2-f325-4b2f-b9e4-7bb137735f08 service nova] Acquiring lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b99d91e9-088f-48fe-9a9d-f7d8a2e01241 req-f6b8d1f2-f325-4b2f-b9e4-7bb137735f08 service nova] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b99d91e9-088f-48fe-9a9d-f7d8a2e01241 req-f6b8d1f2-f325-4b2f-b9e4-7bb137735f08 service nova] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-b99d91e9-088f-48fe-9a9d-f7d8a2e01241 req-f6b8d1f2-f325-4b2f-b9e4-7bb137735f08 service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] No waiting events found dispatching network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:52:50 user nova-compute[75288]: WARNING nova.compute.manager [req-b99d91e9-088f-48fe-9a9d-f7d8a2e01241 req-f6b8d1f2-f325-4b2f-b9e4-7bb137735f08 service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received unexpected event network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b for instance with vm_state building and task_state spawning.
Dec 01 13:52:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:52:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Instance spawned successfully.
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-62bf795b-3cbd-40ff-89ef-2bc73de9c6f9 req-6ff9d1fc-0fde-4522-beac-8992903bf03f service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received event network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-62bf795b-3cbd-40ff-89ef-2bc73de9c6f9 req-6ff9d1fc-0fde-4522-beac-8992903bf03f service nova] Acquiring lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-62bf795b-3cbd-40ff-89ef-2bc73de9c6f9 req-6ff9d1fc-0fde-4522-beac-8992903bf03f service nova] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-62bf795b-3cbd-40ff-89ef-2bc73de9c6f9 req-6ff9d1fc-0fde-4522-beac-8992903bf03f service nova] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-62bf795b-3cbd-40ff-89ef-2bc73de9c6f9 req-6ff9d1fc-0fde-4522-beac-8992903bf03f service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] No waiting events found dispatching network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:52:52 user nova-compute[75288]: WARNING nova.compute.manager [req-62bf795b-3cbd-40ff-89ef-2bc73de9c6f9 req-6ff9d1fc-0fde-4522-beac-8992903bf03f service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received unexpected event network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b for instance with vm_state building and task_state spawning.
Dec 01 13:52:52 user nova-compute[75288]: INFO nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Took 6.57 seconds to spawn the instance on the hypervisor.
Dec 01 13:52:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:52:52 user nova-compute[75288]: INFO nova.compute.manager [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Took 7.78 seconds to build instance.
Dec 01 13:52:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1321da1-02ec-42f7-8860-60f4b5170869 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.908s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:52:55 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae is timed out.
Dec 01 13:52:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Successfully detached device vdc from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae from the live domain config.
Dec 01 13:52:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKkLPrlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:52:55 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fdba6a-3ae8-498e-bd4b-bc7d740d7bd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:52:55 user nova-compute[75288]: No targets found.
Dec 01 13:52:55 user nova-compute[75288]: iSNS:
Dec 01 13:52:55 user nova-compute[75288]: No targets found.
Dec 01 13:52:55 user nova-compute[75288]: STATIC:
Dec 01 13:52:55 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:52:55 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:52:55 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:52:55 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494
Dec 01 13:52:55 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:52:55 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:52:55 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763
Dec 01 13:52:55 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:52:55 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:52:55 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:52:55 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:52:55 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:52:55 user nova-compute[75288]: FIRMWARE:
Dec 01 13:52:55 user nova-compute[75288]: No targets found.
Dec 01 13:52:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:52:55 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:52:55 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da02807-4c7a-404d-a034-24867e26cc6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[024d84df-2522-4599-895f-2421d496da1c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:55 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:55 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:55 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 (non-flash)
Dec 01 13:52:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:52:55 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:52:55 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:52:55 user nova-compute[75288]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 (non-flash)
Dec 01 13:52:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98c8f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763'): ({'sdf'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Removing single pathed devices sdf {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91863a1-b18a-4699-b4ab-5f37f5e086ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb9efea-d511-44ec-a153-85e3215bec08]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Flushing IO for device /dev/sdf {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2db790-9c71-454f-9d3b-edad227db4c3]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a783bfbf-028c-44d7-ac19-9b2db27a67a4]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb647c-e7f5-4f93-80cf-d3619c97f856]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5cffbd-adce-4952-84f1-cd73088d3429]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763, portal: 172.16.0.220,3260]
Dec 01 13:52:55 user nova-compute[75288]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763, portal: 172.16.0.220,3260] successful.
Dec 01 13:52:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c906767-a6e3-40aa-bbbc-b67043bc7763 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[02195f5e-5a94-4a35-828d-482736c906f4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] <== disconnect_volume: return (316ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:52:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:52:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lazy-loading 'flavor' on Instance uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:52:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-12457db4-045f-4653-a393-09fa29842d4b tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:52:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updating instance_info_cache with network_info: [{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:09 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:14 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:14 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7489MB free_disk=25.276077270507812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ce476b0b-4ed7-42bc-9801-860255953006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0643ed1e-37b9-4a4b-b260-c9dc602190ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:53:14 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:53:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:53:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-15324d74-62c6-4a74-8b79-6b82b304f92d req-fb05a0f2-dece-48bd-8a99-e2fa6d03c6c9 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-changed-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-15324d74-62c6-4a74-8b79-6b82b304f92d req-fb05a0f2-dece-48bd-8a99-e2fa6d03c6c9 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Refreshing instance network info cache due to event network-changed-f892e403-d0f3-4631-859d-6e101c9b33de. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:53:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15324d74-62c6-4a74-8b79-6b82b304f92d req-fb05a0f2-dece-48bd-8a99-e2fa6d03c6c9 service nova] Acquiring lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15324d74-62c6-4a74-8b79-6b82b304f92d req-fb05a0f2-dece-48bd-8a99-e2fa6d03c6c9 service nova] Acquired lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:20 user nova-compute[75288]: DEBUG nova.network.neutron [req-15324d74-62c6-4a74-8b79-6b82b304f92d req-fb05a0f2-dece-48bd-8a99-e2fa6d03c6c9 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Refreshing network info cache for port f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:53:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-15324d74-62c6-4a74-8b79-6b82b304f92d req-fb05a0f2-dece-48bd-8a99-e2fa6d03c6c9 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updated VIF entry in instance network info cache for port f892e403-d0f3-4631-859d-6e101c9b33de. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:53:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-15324d74-62c6-4a74-8b79-6b82b304f92d req-fb05a0f2-dece-48bd-8a99-e2fa6d03c6c9 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updating instance_info_cache with network_info: [{"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-15324d74-62c6-4a74-8b79-6b82b304f92d req-fb05a0f2-dece-48bd-8a99-e2fa6d03c6c9 service nova] Releasing lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:25 user nova-compute[75288]: INFO nova.compute.manager [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Detaching volume fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494
Dec 01 13:53:25 user nova-compute[75288]: INFO nova.virt.block_device [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Attempting to driver detach volume fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 from mountpoint /dev/vdb
Dec 01 13:53:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Attempting to detach device vdb from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:53:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:53:25 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:53:25 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:53:25 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:53:25 user nova-compute[75288]:   <serial>fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494</serial>
Dec 01 13:53:25 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:53:25 user nova-compute[75288]: </disk>
Dec 01 13:53:25 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:53:25 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Successfully detached device vdb from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae from the persistent domain config.
Dec 01 13:53:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:53:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:53:25 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:53:25 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:53:25 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:53:25 user nova-compute[75288]:   <serial>fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494</serial>
Dec 01 13:53:25 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:53:25 user nova-compute[75288]: </disk>
Dec 01 13:53:25 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:53:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:53:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "515aad26-e3ca-4046-84bb-d1aea072c04e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:53:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:53:29 user nova-compute[75288]: INFO nova.compute.claims [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Claim successful on node user
Dec 01 13:53:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:53:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:53:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:53:30 user nova-compute[75288]: INFO nova.virt.block_device [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Booting with volume 8d2f7a26-cde2-4580-904a-d649483cb296 at /dev/vda
Dec 01 13:53:30 user nova-compute[75288]: DEBUG nova.policy [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab6a9e09550e42edac3c1e8a9112fbd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1120cc4cc3d8458aaf5755a500e994c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG os_brick.utils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf10652-1a17-4d48-a273-a153a4ad7a17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[393a2cd8-4b46-4629-a0d3-28e1d330f589]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[df71ad7f-185d-46dd-8e79-764a3f89b9c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b890bd6-676c-4d92-930e-fd8d43ed2e07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:53:30 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:53:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[45700879-a897-4d98-be63-1af788daba7d]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG os_brick.utils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:53:30 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updating existing volume attachment record: 593d7e12-831d-4b39-a5c2-84ec77180552 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:53:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Successfully created port: 5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Successfully updated port: 5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquired lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-41f32fd4-61b0-4f78-b07a-8bd2f2473355 req-abfd8482-092c-4d6f-a48b-e0ddb71dacb7 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-changed-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-41f32fd4-61b0-4f78-b07a-8bd2f2473355 req-abfd8482-092c-4d6f-a48b-e0ddb71dacb7 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Refreshing instance network info cache due to event network-changed-5917cafb-8c56-4596-a17c-e6babc227cfe. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f32fd4-61b0-4f78-b07a-8bd2f2473355 req-abfd8482-092c-4d6f-a48b-e0ddb71dacb7 service nova] Acquiring lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updating instance_info_cache with network_info: [{"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Releasing lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Instance network_info: |[{"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f32fd4-61b0-4f78-b07a-8bd2f2473355 req-abfd8482-092c-4d6f-a48b-e0ddb71dacb7 service nova] Acquired lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-41f32fd4-61b0-4f78-b07a-8bd2f2473355 req-abfd8482-092c-4d6f-a48b-e0ddb71dacb7 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Refreshing network info cache for port 5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:53:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-41f32fd4-61b0-4f78-b07a-8bd2f2473355 req-abfd8482-092c-4d6f-a48b-e0ddb71dacb7 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updated VIF entry in instance network info cache for port 5917cafb-8c56-4596-a17c-e6babc227cfe. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:53:33 user nova-compute[75288]: DEBUG nova.network.neutron [req-41f32fd4-61b0-4f78-b07a-8bd2f2473355 req-abfd8482-092c-4d6f-a48b-e0ddb71dacb7 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updating instance_info_cache with network_info: [{"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f32fd4-61b0-4f78-b07a-8bd2f2473355 req-abfd8482-092c-4d6f-a48b-e0ddb71dacb7 service nova] Releasing lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-012e5f31-17eb-4fa8-91ec-d4415f3d3d47 req-6951f012-9138-4dbe-b10d-3f403eec132e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-changed-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-012e5f31-17eb-4fa8-91ec-d4415f3d3d47 req-6951f012-9138-4dbe-b10d-3f403eec132e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Refreshing instance network info cache due to event network-changed-d2e3b708-7d4a-4339-880a-bfe8801dadc0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012e5f31-17eb-4fa8-91ec-d4415f3d3d47 req-6951f012-9138-4dbe-b10d-3f403eec132e service nova] Acquiring lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012e5f31-17eb-4fa8-91ec-d4415f3d3d47 req-6951f012-9138-4dbe-b10d-3f403eec132e service nova] Acquired lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-012e5f31-17eb-4fa8-91ec-d4415f3d3d47 req-6951f012-9138-4dbe-b10d-3f403eec132e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Refreshing network info cache for port d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'flavor' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-012e5f31-17eb-4fa8-91ec-d4415f3d3d47 req-6951f012-9138-4dbe-b10d-3f403eec132e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updated VIF entry in instance network info cache for port d2e3b708-7d4a-4339-880a-bfe8801dadc0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-012e5f31-17eb-4fa8-91ec-d4415f3d3d47 req-6951f012-9138-4dbe-b10d-3f403eec132e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating instance_info_cache with network_info: [{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:37 user nova-compute[75288]: INFO nova.compute.manager [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Attaching volume e55ba83a-624c-4d40-b278-7d922c7a11ef to /dev/vdb
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-012e5f31-17eb-4fa8-91ec-d4415f3d3d47 req-6951f012-9138-4dbe-b10d-3f403eec132e service nova] Releasing lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13fcc59-8e35-4131-a2ab-e0d91f0a0404]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64e0c18-7d9c-456c-90bf-5c3a967dc26a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bcf08c-28ad-40c1-b588-ea06a498c9b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa47a08-3b77-4305-bf94-b55197e6479d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:53:37 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:53:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a0f001-eb88-4426-99ef-c6d31191b3d6]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:53:37 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating existing volume attachment record: 5dcd053e-5c41-412e-9970-33381597163b {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:53:38 user nova-compute[75288]: INFO nova.compute.claims [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Claim successful on node user
Dec 01 13:53:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:53:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:53:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG nova.policy [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d51f494066a46c1b7fe1ed789318010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab4adede7a473d9b75844aa0d9da42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:53:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Creating image(s)
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.209s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk 1073741824" returned: 0 in 0.052s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Successfully created port: a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:53:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Cannot resize image /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Ensure instance console log exists: /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Successfully updated port: a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquired lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-2e5b5c5b-73e3-479b-bc7c-a7802b67e9a8 req-410950ca-ed44-4153-a5df-fb3ed3cc7a41 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-changed-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-2e5b5c5b-73e3-479b-bc7c-a7802b67e9a8 req-410950ca-ed44-4153-a5df-fb3ed3cc7a41 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Refreshing instance network info cache due to event network-changed-a4d06e3a-671b-493e-b9b8-4400f24f7877. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2e5b5c5b-73e3-479b-bc7c-a7802b67e9a8 req-410950ca-ed44-4153-a5df-fb3ed3cc7a41 service nova] Acquiring lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Releasing lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance network_info: |[{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2e5b5c5b-73e3-479b-bc7c-a7802b67e9a8 req-410950ca-ed44-4153-a5df-fb3ed3cc7a41 service nova] Acquired lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-2e5b5c5b-73e3-479b-bc7c-a7802b67e9a8 req-410950ca-ed44-4153-a5df-fb3ed3cc7a41 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Refreshing network info cache for port a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Start _get_guest_xml network_info=[{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:53:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839517980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839517980',id=30,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQjRBfwBrWv++1UyxHenT16L3KFq6cSakLqlfmoGCl+bZVIfzlkHjCfl3H+BqULca2NxH+oj7D7R0RHzmyXm6b4Z/EU4SiGeF/xATyhIZFOE6n8jfxD/M/LqDc9wbO0Dw==',key_name='tempest-keypair-1302462361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-1nhecb1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=d175885c-b192-4e34-b48c-33cd3809076e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'pci_devices' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:53:40 user nova-compute[75288]:   <uuid>d175885c-b192-4e34-b48c-33cd3809076e</uuid>
Dec 01 13:53:40 user nova-compute[75288]:   <name>instance-0000001e</name>
Dec 01 13:53:40 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:53:40 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:53:40 user nova-compute[75288]:   <metadata>
Dec 01 13:53:40 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:53:40 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:53:40 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-839517980</nova:name>
Dec 01 13:53:40 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:53:40</nova:creationTime>
Dec 01 13:53:40 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:53:40 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:53:40 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:53:40 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:53:40 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:53:40 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:53:40 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:53:40 user nova-compute[75288]:       <nova:owner>
Dec 01 13:53:40 user nova-compute[75288]:         <nova:user uuid="4d51f494066a46c1b7fe1ed789318010">tempest-AttachVolumeShelveTestJSON-548010779-project-member</nova:user>
Dec 01 13:53:40 user nova-compute[75288]:         <nova:project uuid="d0ab4adede7a473d9b75844aa0d9da42">tempest-AttachVolumeShelveTestJSON-548010779</nova:project>
Dec 01 13:53:40 user nova-compute[75288]:       </nova:owner>
Dec 01 13:53:40 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:53:40 user nova-compute[75288]:       <nova:ports>
Dec 01 13:53:40 user nova-compute[75288]:         <nova:port uuid="a4d06e3a-671b-493e-b9b8-4400f24f7877">
Dec 01 13:53:40 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 13:53:40 user nova-compute[75288]:         </nova:port>
Dec 01 13:53:40 user nova-compute[75288]:       </nova:ports>
Dec 01 13:53:40 user nova-compute[75288]:     </nova:instance>
Dec 01 13:53:40 user nova-compute[75288]:   </metadata>
Dec 01 13:53:40 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:53:40 user nova-compute[75288]:     <system>
Dec 01 13:53:40 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:53:40 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:53:40 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:53:40 user nova-compute[75288]:       <entry name="serial">d175885c-b192-4e34-b48c-33cd3809076e</entry>
Dec 01 13:53:40 user nova-compute[75288]:       <entry name="uuid">d175885c-b192-4e34-b48c-33cd3809076e</entry>
Dec 01 13:53:40 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:53:40 user nova-compute[75288]:     </system>
Dec 01 13:53:40 user nova-compute[75288]:   </sysinfo>
Dec 01 13:53:40 user nova-compute[75288]:   <os>
Dec 01 13:53:40 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:53:40 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:53:40 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:53:40 user nova-compute[75288]:   </os>
Dec 01 13:53:40 user nova-compute[75288]:   <features>
Dec 01 13:53:40 user nova-compute[75288]:     <acpi/>
Dec 01 13:53:40 user nova-compute[75288]:     <apic/>
Dec 01 13:53:40 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:53:40 user nova-compute[75288]:   </features>
Dec 01 13:53:40 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:53:40 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:53:40 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:53:40 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:53:40 user nova-compute[75288]:   </clock>
Dec 01 13:53:40 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:53:40 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:53:40 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:53:40 user nova-compute[75288]:   </cpu>
Dec 01 13:53:40 user nova-compute[75288]:   <devices>
Dec 01 13:53:40 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:53:40 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:53:40 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk"/>
Dec 01 13:53:40 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:53:40 user nova-compute[75288]:     </disk>
Dec 01 13:53:40 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:53:40 user nova-compute[75288]:       <mac address="fa:16:3e:a8:39:41"/>
Dec 01 13:53:40 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:40 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:53:40 user nova-compute[75288]:       <target dev="tapa4d06e3a-67"/>
Dec 01 13:53:40 user nova-compute[75288]:     </interface>
Dec 01 13:53:40 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:53:40 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/console.log" append="off"/>
Dec 01 13:53:40 user nova-compute[75288]:     </serial>
Dec 01 13:53:40 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:53:40 user nova-compute[75288]:     <video>
Dec 01 13:53:40 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:40 user nova-compute[75288]:     </video>
Dec 01 13:53:40 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:53:40 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:53:40 user nova-compute[75288]:     </rng>
Dec 01 13:53:40 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:53:40 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:53:40 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:53:40 user nova-compute[75288]:     </memballoon>
Dec 01 13:53:40 user nova-compute[75288]:   </devices>
Dec 01 13:53:40 user nova-compute[75288]: </domain>
Dec 01 13:53:40 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839517980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839517980',id=30,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQjRBfwBrWv++1UyxHenT16L3KFq6cSakLqlfmoGCl+bZVIfzlkHjCfl3H+BqULca2NxH+oj7D7R0RHzmyXm6b4Z/EU4SiGeF/xATyhIZFOE6n8jfxD/M/LqDc9wbO0Dw==',key_name='tempest-keypair-1302462361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-1nhecb1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:53:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=d175885c-b192-4e34-b48c-33cd3809076e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG os_vif [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '767127d8-fd38-5bfb-9896-4e18d91c5527', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4d06e3a-67, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4d06e3a-67, col_values=(('qos', UUID('052b80db-2ba3-4906-88fb-529b4fe95e7a')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4d06e3a-67, col_values=(('external_ids', {'iface-id': 'a4d06e3a-671b-493e-b9b8-4400f24f7877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:39:41', 'vm-uuid': 'd175885c-b192-4e34-b48c-33cd3809076e'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:53:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:40 user nova-compute[75288]: INFO os_vif [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67')
Dec 01 13:53:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No VIF found with MAC fa:16:3e:a8:39:41, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:53:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-2e5b5c5b-73e3-479b-bc7c-a7802b67e9a8 req-410950ca-ed44-4153-a5df-fb3ed3cc7a41 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updated VIF entry in instance network info cache for port a4d06e3a-671b-493e-b9b8-4400f24f7877. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:53:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-2e5b5c5b-73e3-479b-bc7c-a7802b67e9a8 req-410950ca-ed44-4153-a5df-fb3ed3cc7a41 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2e5b5c5b-73e3-479b-bc7c-a7802b67e9a8 req-410950ca-ed44-4153-a5df-fb3ed3cc7a41 service nova] Releasing lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:41 user nova-compute[75288]: INFO nova.compute.manager [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Rescuing
Dec 01 13:53:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquired lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:41 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updating instance_info_cache with network_info: [{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Releasing lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-9fa87456-2408-43c6-b9db-6a811dba08d4 req-7f9c1a88-7c6a-4946-86ff-6a21c81a48a7 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9fa87456-2408-43c6-b9db-6a811dba08d4 req-7f9c1a88-7c6a-4946-86ff-6a21c81a48a7 service nova] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9fa87456-2408-43c6-b9db-6a811dba08d4 req-7f9c1a88-7c6a-4946-86ff-6a21c81a48a7 service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9fa87456-2408-43c6-b9db-6a811dba08d4 req-7f9c1a88-7c6a-4946-86ff-6a21c81a48a7 service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-9fa87456-2408-43c6-b9db-6a811dba08d4 req-7f9c1a88-7c6a-4946-86ff-6a21c81a48a7 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] No waiting events found dispatching network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:42 user nova-compute[75288]: WARNING nova.compute.manager [req-9fa87456-2408-43c6-b9db-6a811dba08d4 req-7f9c1a88-7c6a-4946-86ff-6a21c81a48a7 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received unexpected event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 for instance with vm_state building and task_state spawning.
Dec 01 13:53:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance destroyed successfully.
Dec 01 13:53:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Attempting a stable device rescue
Dec 01 13:53:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 13:53:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Creating image(s)
Dec 01 13:53:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "/opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "/opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "/opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'trusted_certs' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "b4d08e4f31533726629511ac63ebfd458b422839" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "b4d08e4f31533726629511ac63ebfd458b422839" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] No waiting events found dispatching network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:44 user nova-compute[75288]: WARNING nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received unexpected event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 for instance with vm_state building and task_state spawning.
Dec 01 13:53:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:44 user nova-compute[75288]: WARNING nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state active and task_state rescuing.
Dec 01 13:53:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:44 user nova-compute[75288]: WARNING nova.compute.manager [req-080456d3-c100-4267-ad9e-5b5346badef4 req-90ed3c22-9df5-49cf-a8e0-7c85785aada9 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state active and task_state rescuing.
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839.part --force-share --output=json" returned: 0 in 0.266s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG nova.virt.images [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] 9248d1a3-3179-4f41-afee-824411d769a7 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:53:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839.part /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839.part /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839.converted" returned: 0 in 0.326s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:53:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance spawned successfully.
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "b4d08e4f31533726629511ac63ebfd458b422839" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.077s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "b4d08e4f31533726629511ac63ebfd458b422839" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "b4d08e4f31533726629511ac63ebfd458b422839" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:45 user nova-compute[75288]: INFO nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Took 6.34 seconds to spawn the instance on the hypervisor.
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839 --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839,backing_fmt=raw /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:53:45 user nova-compute[75288]: INFO nova.compute.manager [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Took 7.45 seconds to build instance.
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839,backing_fmt=raw /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue" returned: 0 in 0.076s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "b4d08e4f31533726629511ac63ebfd458b422839" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'migration_context' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.objects.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<e38d99ed-efd9-4222-aaae-b06934bfac06> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Start _get_guest_xml network_info=[{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "vif_mac": "fa:16:3e:45:44:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9248d1a3-3179-4f41-afee-824411d769a7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6d19d4b1-62b9-40e3-89e8-8ece03118d47', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekPXMDlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e38d99ed-efd9-4222-aaae-b06934bfac06', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'serial': 'fc17edfe-3a58-4536-bcc4-9419c41d4f2f'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'resources' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e62f14a5-672a-4644-a0b2-f77796752f24 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.572s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.objects.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<e38d99ed-efd9-4222-aaae-b06934bfac06> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'numa_topology' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.objects.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<e38d99ed-efd9-4222-aaae-b06934bfac06> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:45 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:45 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'vcpu_model' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:53:45 user nova-compute[75288]: INFO nova.compute.claims [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Claim successful on node user
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.objects.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<e38d99ed-efd9-4222-aaae-b06934bfac06> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekPXMDlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:53:45 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:53:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:53:45 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:53:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:53:45 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ef2732-4ac0-4d25-8428-87b7b3b750b3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ekPXMDlg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 13:53:45 user nova-compute[75288]: node.name = iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:53:45 user nova-compute[75288]: node.tpgt = -1
Dec 01 13:53:45 user nova-compute[75288]: node.startup = automatic
Dec 01 13:53:45 user nova-compute[75288]: node.leading_login = No
Dec 01 13:53:45 user nova-compute[75288]: iface.iscsi_ifacename = default
Dec 01 13:53:45 user nova-compute[75288]: iface.net_ifacename = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.ipaddress = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.prefix_len = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.hwaddress = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.transport_name = tcp
Dec 01 13:53:45 user nova-compute[75288]: iface.initiatorname = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.state = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.vlan_id = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.vlan_priority = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.vlan_state = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.iface_num = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.mtu = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.port = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.bootproto = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.subnet_mask = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.gateway = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.dhcp_alt_client_id = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.dhcp_dns = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.dhcp_learn_iqn = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.dhcp_vendor_id_state = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.dhcp_vendor_id = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.dhcp_slp_da = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.fragmentation = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.gratuitous_arp = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.incoming_forwarding = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.tos_state = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.tos = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.ttl = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.delayed_ack = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.tcp_nagle = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.tcp_wsf_state = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.tcp_wsf = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.tcp_timer_scale = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.tcp_timestamp = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.redirect = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.def_task_mgmt_timeout = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.header_digest = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.data_digest = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.immediate_data = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.initial_r2t = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.data_seq_inorder = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.data_pdu_inorder = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.erl = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.max_receive_data_len = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.first_burst_len = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.max_outstanding_r2t = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.max_burst_len = 0
Dec 01 13:53:45 user nova-compute[75288]: iface.chap_auth = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.bidi_chap = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.strict_login_compliance = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.discovery_auth = <empty>
Dec 01 13:53:45 user nova-compute[75288]: iface.discovery_logout = <empty>
Dec 01 13:53:45 user nova-compute[75288]: node.discovery_address = <empty>
Dec 01 13:53:45 user nova-compute[75288]: node.discovery_port = 0
Dec 01 13:53:45 user nova-compute[75288]: node.discovery_type = static
Dec 01 13:53:45 user nova-compute[75288]: node.session.initial_cmdsn = 0
Dec 01 13:53:45 user nova-compute[75288]: node.session.initial_login_retry_max = 8
Dec 01 13:53:45 user nova-compute[75288]: node.session.xmit_thread_priority = -20
Dec 01 13:53:45 user nova-compute[75288]: node.session.cmds_max = 128
Dec 01 13:53:45 user nova-compute[75288]: node.session.queue_depth = 32
Dec 01 13:53:45 user nova-compute[75288]: node.session.nr_sessions = 1
Dec 01 13:53:45 user nova-compute[75288]: node.session.auth.authmethod = CHAP
Dec 01 13:53:45 user nova-compute[75288]: node.session.auth.username = ekPXMDlg
Dec 01 13:53:45 user nova-compute[75288]: node.session.auth.password = ***
Dec 01 13:53:45 user nova-compute[75288]: node.session.auth.username_in = <empty>
Dec 01 13:53:45 user nova-compute[75288]: node.session.auth.password_in = <empty>
Dec 01 13:53:45 user nova-compute[75288]: node.session.auth.chap_algs = MD5
Dec 01 13:53:45 user nova-compute[75288]: node.session.timeo.replacement_timeout = 120
Dec 01 13:53:45 user nova-compute[75288]: node.session.err_timeo.abort_timeout = 15
Dec 01 13:53:45 user nova-compute[75288]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 13:53:45 user nova-compute[75288]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 13:53:45 user nova-compute[75288]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.FastAbort = Yes
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.InitialR2T = No
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.ImmediateData = Yes
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.MaxConnections = 1
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 13:53:45 user nova-compute[75288]: node.session.iscsi.ERL = 0
Dec 01 13:53:45 user nova-compute[75288]: node.session.scan = manual
Dec 01 13:53:45 user nova-compute[75288]: node.session.reopen_max = 0
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].address = 172.16.0.220
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].port = 3260
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].startup = manual
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].tcp.window_size = 524288
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].tcp.type_of_service = 0
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].timeo.logout_timeout = 15
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].timeo.login_timeout = 15
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].timeo.auth_timeout = 45
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].iscsi.DataDigest = None
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].iscsi.IFMarker = No
Dec 01 13:53:45 user nova-compute[75288]: node.conn[0].iscsi.OFMarker = No
Dec 01 13:53:45 user nova-compute[75288]: # END RECORD
Dec 01 13:53:45 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8ac455-3793-475f-82b5-25852f6dd6b8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1c0d24-877c-468c-8410-b8d2a2042544]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekPXMDlg {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekPXMDlg" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875a895-d3f7-499a-b3ff-e1372609689e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ekPXMDlg'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f859d2c-6776-43eb-b0d4-022693c7eece]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[673854b4-59e8-46ba-8eeb-5aedb768aeb8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae is timed out.
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:46 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:46 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:53:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:46 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:46 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:53:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.199s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] HCTL ('34', '0', '0', 0) found on session 24 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:53:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Successfully detached device vdb from instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae from the live domain config.
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kbrZHKNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:53:46 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a247c2-f8bb-442f-b7e6-7e29fd6a1dfc]: (4, ('0 0 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching for a device in session 24 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekPXMDlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.229s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] <== connect_volume: return (231ms) {'type': 'block', 'scsi_wwn': '26133366535643162', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133366535643162', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.015s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f036c61b-7e46-4702-b872-fa8e2d1bd422]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:53:46 user nova-compute[75288]: No targets found.
Dec 01 13:53:46 user nova-compute[75288]: iSNS:
Dec 01 13:53:46 user nova-compute[75288]: No targets found.
Dec 01 13:53:46 user nova-compute[75288]: STATIC:
Dec 01 13:53:46 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:53:46 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:53:46 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:53:46 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494
Dec 01 13:53:46 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:53:46 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:53:46 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:53:46 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:53:46 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:53:46 user nova-compute[75288]: FIRMWARE:
Dec 01 13:53:46 user nova-compute[75288]: No targets found.
Dec 01 13:53:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:53:46 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:53:46 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-869445862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-869445862',id=27,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:52:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-bou0lhif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:52:20Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=e38d99ed-efd9-4222-aaae-b06934bfac06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "vif_mac": "fa:16:3e:45:44:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "vif_mac": "fa:16:3e:45:44:61"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:44:61,bridge_name='br-int',has_traffic_filtering=True,id=bf72b948-d727-4c36-af5f-57b0b21b2d4c,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf72b948-d7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'pci_devices' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebfad99-793e-471c-b481-8ec691dca7fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.objects.base [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<e38d99ed-efd9-4222-aaae-b06934bfac06> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:53:46 user nova-compute[75288]:   <uuid>e38d99ed-efd9-4222-aaae-b06934bfac06</uuid>
Dec 01 13:53:46 user nova-compute[75288]:   <name>instance-0000001b</name>
Dec 01 13:53:46 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:53:46 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:53:46 user nova-compute[75288]:   <metadata>
Dec 01 13:53:46 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:53:46 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:53:46 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-869445862</nova:name>
Dec 01 13:53:46 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:53:45</nova:creationTime>
Dec 01 13:53:46 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:53:46 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:53:46 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:53:46 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:53:46 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:53:46 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:53:46 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:53:46 user nova-compute[75288]:       <nova:owner>
Dec 01 13:53:46 user nova-compute[75288]:         <nova:user uuid="69266afe5e404e259d679d7498f99faa">tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member</nova:user>
Dec 01 13:53:46 user nova-compute[75288]:         <nova:project uuid="2e6b677b10d14d63984895b4cfbdad4b">tempest-ServerBootFromVolumeStableRescueTest-64531845</nova:project>
Dec 01 13:53:46 user nova-compute[75288]:       </nova:owner>
Dec 01 13:53:46 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:53:46 user nova-compute[75288]:       <nova:ports>
Dec 01 13:53:46 user nova-compute[75288]:         <nova:port uuid="bf72b948-d727-4c36-af5f-57b0b21b2d4c">
Dec 01 13:53:46 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:53:46 user nova-compute[75288]:         </nova:port>
Dec 01 13:53:46 user nova-compute[75288]:       </nova:ports>
Dec 01 13:53:46 user nova-compute[75288]:     </nova:instance>
Dec 01 13:53:46 user nova-compute[75288]:   </metadata>
Dec 01 13:53:46 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:53:46 user nova-compute[75288]:     <system>
Dec 01 13:53:46 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:53:46 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:53:46 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:53:46 user nova-compute[75288]:       <entry name="serial">e38d99ed-efd9-4222-aaae-b06934bfac06</entry>
Dec 01 13:53:46 user nova-compute[75288]:       <entry name="uuid">e38d99ed-efd9-4222-aaae-b06934bfac06</entry>
Dec 01 13:53:46 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:53:46 user nova-compute[75288]:     </system>
Dec 01 13:53:46 user nova-compute[75288]:   </sysinfo>
Dec 01 13:53:46 user nova-compute[75288]:   <os>
Dec 01 13:53:46 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:53:46 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:53:46 user nova-compute[75288]:   </os>
Dec 01 13:53:46 user nova-compute[75288]:   <features>
Dec 01 13:53:46 user nova-compute[75288]:     <acpi/>
Dec 01 13:53:46 user nova-compute[75288]:     <apic/>
Dec 01 13:53:46 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:53:46 user nova-compute[75288]:   </features>
Dec 01 13:53:46 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:53:46 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:53:46 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:53:46 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:53:46 user nova-compute[75288]:   </clock>
Dec 01 13:53:46 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:53:46 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:53:46 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:53:46 user nova-compute[75288]:   </cpu>
Dec 01 13:53:46 user nova-compute[75288]:   <devices>
Dec 01 13:53:46 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:53:46 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:53:46 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Dec 01 13:53:46 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:53:46 user nova-compute[75288]:       <serial>fc17edfe-3a58-4536-bcc4-9419c41d4f2f</serial>
Dec 01 13:53:46 user nova-compute[75288]:     </disk>
Dec 01 13:53:46 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:53:46 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:53:46 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue"/>
Dec 01 13:53:46 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 13:53:46 user nova-compute[75288]:       <boot order="1"/>
Dec 01 13:53:46 user nova-compute[75288]:     </disk>
Dec 01 13:53:46 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:53:46 user nova-compute[75288]:       <mac address="fa:16:3e:45:44:61"/>
Dec 01 13:53:46 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:46 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:53:46 user nova-compute[75288]:       <target dev="tapbf72b948-d7"/>
Dec 01 13:53:46 user nova-compute[75288]:     </interface>
Dec 01 13:53:46 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:53:46 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/console.log" append="off"/>
Dec 01 13:53:46 user nova-compute[75288]:     </serial>
Dec 01 13:53:46 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:53:46 user nova-compute[75288]:     <video>
Dec 01 13:53:46 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:46 user nova-compute[75288]:     </video>
Dec 01 13:53:46 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:53:46 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:53:46 user nova-compute[75288]:     </rng>
Dec 01 13:53:46 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:53:46 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:53:46 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:53:46 user nova-compute[75288]:     </memballoon>
Dec 01 13:53:46 user nova-compute[75288]:   </devices>
Dec 01 13:53:46 user nova-compute[75288]: </domain>
Dec 01 13:53:46 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada27675-6a86-4519-9e6b-6235269caa40]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:46 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:46 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:53:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:46 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:46 user nova-compute[75288]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 (non-flash)
Dec 01 13:53:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98daf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance destroyed successfully.
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76a8145-9dd7-4007-9edc-5c91f3e86142]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0b238f-522a-4f7e-9982-3ee9c064cdd6]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f43bd4-7aaf-4b5d-b752-413da67b4aa2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No VIF found with MAC fa:16:3e:45:44:61, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.124s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a95711-432d-4f18-93d8-d50441bd080e]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a34e6-eaab-432e-8760-22e4e51ff47f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b8ee9-7bd1-4a8f-b3a4-3d6e37fc56b2]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494, portal: 172.16.0.220,3260]
Dec 01 13:53:46 user nova-compute[75288]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494, portal: 172.16.0.220,3260] successful.
Dec 01 13:53:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe85f0d1-4b82-4420-9a5b-3b9ebdb7b494 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5348aa9-f020-46a4-adb6-98a4810b912a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.457s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] <== disconnect_volume: return (472ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.780s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:53:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:53:46 user nova-compute[75288]: DEBUG nova.policy [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e384ef4f5a36497d8e805cf7cc87f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b0750b8b4f199df0d6dfe6136a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:53:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Creating image(s)
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "/opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "/opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.225s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk 1073741824" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.411s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Successfully created port: ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lazy-loading 'flavor' on Instance uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4726705b-4b5f-4516-b4e2-71a364a95156 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.237s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:53:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Cannot resize image /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Ensure instance console log exists: /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-19ead157-17f6-499c-aed3-187ee692da5a req-c1e48d46-71b4-4ff1-9849-64fb52907377 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-19ead157-17f6-499c-aed3-187ee692da5a req-c1e48d46-71b4-4ff1-9849-64fb52907377 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-19ead157-17f6-499c-aed3-187ee692da5a req-c1e48d46-71b4-4ff1-9849-64fb52907377 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-19ead157-17f6-499c-aed3-187ee692da5a req-c1e48d46-71b4-4ff1-9849-64fb52907377 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-19ead157-17f6-499c-aed3-187ee692da5a req-c1e48d46-71b4-4ff1-9849-64fb52907377 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:48 user nova-compute[75288]: WARNING nova.compute.manager [req-19ead157-17f6-499c-aed3-187ee692da5a req-c1e48d46-71b4-4ff1-9849-64fb52907377 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state active and task_state rescuing.
Dec 01 13:53:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Successfully updated port: ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquired lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-52171804-48a8-4399-b44c-59e166747490 req-c5e2a8d1-7d08-4e5b-ab05-32e0e7649193 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received event network-changed-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-52171804-48a8-4399-b44c-59e166747490 req-c5e2a8d1-7d08-4e5b-ab05-32e0e7649193 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Refreshing instance network info cache due to event network-changed-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-52171804-48a8-4399-b44c-59e166747490 req-c5e2a8d1-7d08-4e5b-ab05-32e0e7649193 service nova] Acquiring lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:53:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Creating image(s)
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Ensure instance console log exists: /opt/stack/data/nova/instances/515aad26-e3ca-4046-84bb-d1aea072c04e/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Start _get_guest_xml network_info=[{"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '593d7e12-831d-4b39-a5c2-84ec77180552', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSwmIUok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '515aad26-e3ca-4046-84bb-d1aea072c04e', 'attached_at': '', 'detached_at': '', 'volume_id': '8d2f7a26-cde2-4580-904a-d649483cb296', 'serial': '8d2f7a26-cde2-4580-904a-d649483cb296'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:53:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSwmIUok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:53:48 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:53:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:53:48 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:53:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:53:48 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Updating instance_info_cache with network_info: [{"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Releasing lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Instance network_info: |[{"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-52171804-48a8-4399-b44c-59e166747490 req-c5e2a8d1-7d08-4e5b-ab05-32e0e7649193 service nova] Acquired lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-52171804-48a8-4399-b44c-59e166747490 req-c5e2a8d1-7d08-4e5b-ab05-32e0e7649193 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Refreshing network info cache for port ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Start _get_guest_xml network_info=[{"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dcbc68-f63c-44eb-915d-9bd604c0ea82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:53:48 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0709ab-07e7-4861-b6e1-d594dbd27d34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296] added
Dec 01 13:53:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-541179737',display_name='tempest-VolumesSnapshotTestJSON-instance-541179737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-541179737',id=31,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPailbcxoITl4OEXs8gL6zRh9m8xNOMgQb/p7bKDNL0hKtKPqWIXCX9oWfRxdrmqFphMZCj018JU4o9RgbehQ2RON+eFsZMyfcMXPzr/lyfrGE/sOyZz2w18XKy2hJtw7g==',key_name='tempest-keypair-679868516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab33b0750b8b4f199df0d6dfe6136a8b',ramdisk_id='',reservation_id='r-n15e4nw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-383967549',owner_user_name='tempest-VolumesSnapshotTestJSON-383967549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e384ef4f5a36497d8e805cf7cc87f32e',uuid=cb82677d-4aba-488b-a8f5-33ceada2c0e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converting VIF {"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=ad84b096-90e0-41f9-9baa-2bb79f9a9fb4,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad84b096-90') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'pci_devices' on Instance uuid cb82677d-4aba-488b-a8f5-33ceada2c0e2 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd2df55-e200-491f-84a7-e41dd0b950ef]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:53:49 user nova-compute[75288]:   <uuid>cb82677d-4aba-488b-a8f5-33ceada2c0e2</uuid>
Dec 01 13:53:49 user nova-compute[75288]:   <name>instance-0000001f</name>
Dec 01 13:53:49 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:53:49 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:53:49 user nova-compute[75288]:   <metadata>
Dec 01 13:53:49 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:53:49 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:53:49 user nova-compute[75288]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-541179737</nova:name>
Dec 01 13:53:49 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:53:48</nova:creationTime>
Dec 01 13:53:49 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:53:49 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:53:49 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:53:49 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:53:49 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:53:49 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:53:49 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:53:49 user nova-compute[75288]:       <nova:owner>
Dec 01 13:53:49 user nova-compute[75288]:         <nova:user uuid="e384ef4f5a36497d8e805cf7cc87f32e">tempest-VolumesSnapshotTestJSON-383967549-project-member</nova:user>
Dec 01 13:53:49 user nova-compute[75288]:         <nova:project uuid="ab33b0750b8b4f199df0d6dfe6136a8b">tempest-VolumesSnapshotTestJSON-383967549</nova:project>
Dec 01 13:53:49 user nova-compute[75288]:       </nova:owner>
Dec 01 13:53:49 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:53:49 user nova-compute[75288]:       <nova:ports>
Dec 01 13:53:49 user nova-compute[75288]:         <nova:port uuid="ad84b096-90e0-41f9-9baa-2bb79f9a9fb4">
Dec 01 13:53:49 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 13:53:49 user nova-compute[75288]:         </nova:port>
Dec 01 13:53:49 user nova-compute[75288]:       </nova:ports>
Dec 01 13:53:49 user nova-compute[75288]:     </nova:instance>
Dec 01 13:53:49 user nova-compute[75288]:   </metadata>
Dec 01 13:53:49 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:53:49 user nova-compute[75288]:     <system>
Dec 01 13:53:49 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:53:49 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:53:49 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:53:49 user nova-compute[75288]:       <entry name="serial">cb82677d-4aba-488b-a8f5-33ceada2c0e2</entry>
Dec 01 13:53:49 user nova-compute[75288]:       <entry name="uuid">cb82677d-4aba-488b-a8f5-33ceada2c0e2</entry>
Dec 01 13:53:49 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:53:49 user nova-compute[75288]:     </system>
Dec 01 13:53:49 user nova-compute[75288]:   </sysinfo>
Dec 01 13:53:49 user nova-compute[75288]:   <os>
Dec 01 13:53:49 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:53:49 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:53:49 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:53:49 user nova-compute[75288]:   </os>
Dec 01 13:53:49 user nova-compute[75288]:   <features>
Dec 01 13:53:49 user nova-compute[75288]:     <acpi/>
Dec 01 13:53:49 user nova-compute[75288]:     <apic/>
Dec 01 13:53:49 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:53:49 user nova-compute[75288]:   </features>
Dec 01 13:53:49 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:53:49 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:53:49 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:53:49 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:53:49 user nova-compute[75288]:   </clock>
Dec 01 13:53:49 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:53:49 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:53:49 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:53:49 user nova-compute[75288]:   </cpu>
Dec 01 13:53:49 user nova-compute[75288]:   <devices>
Dec 01 13:53:49 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:53:49 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:53:49 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk"/>
Dec 01 13:53:49 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:53:49 user nova-compute[75288]:     </disk>
Dec 01 13:53:49 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:53:49 user nova-compute[75288]:       <mac address="fa:16:3e:4a:70:0f"/>
Dec 01 13:53:49 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:49 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:53:49 user nova-compute[75288]:       <target dev="tapad84b096-90"/>
Dec 01 13:53:49 user nova-compute[75288]:     </interface>
Dec 01 13:53:49 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:53:49 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/console.log" append="off"/>
Dec 01 13:53:49 user nova-compute[75288]:     </serial>
Dec 01 13:53:49 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:53:49 user nova-compute[75288]:     <video>
Dec 01 13:53:49 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:49 user nova-compute[75288]:     </video>
Dec 01 13:53:49 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:53:49 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:53:49 user nova-compute[75288]:     </rng>
Dec 01 13:53:49 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:53:49 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:53:49 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:53:49 user nova-compute[75288]:     </memballoon>
Dec 01 13:53:49 user nova-compute[75288]:   </devices>
Dec 01 13:53:49 user nova-compute[75288]: </domain>
Dec 01 13:53:49 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-541179737',display_name='tempest-VolumesSnapshotTestJSON-instance-541179737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-541179737',id=31,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPailbcxoITl4OEXs8gL6zRh9m8xNOMgQb/p7bKDNL0hKtKPqWIXCX9oWfRxdrmqFphMZCj018JU4o9RgbehQ2RON+eFsZMyfcMXPzr/lyfrGE/sOyZz2w18XKy2hJtw7g==',key_name='tempest-keypair-679868516',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab33b0750b8b4f199df0d6dfe6136a8b',ramdisk_id='',reservation_id='r-n15e4nw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-383967549',owner_user_name='tempest-VolumesSnapshotTestJSON-383967549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e384ef4f5a36497d8e805cf7cc87f32e',uuid=cb82677d-4aba-488b-a8f5-33ceada2c0e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converting VIF {"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=ad84b096-90e0-41f9-9baa-2bb79f9a9fb4,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad84b096-90') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_vif [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=ad84b096-90e0-41f9-9baa-2bb79f9a9fb4,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad84b096-90') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f02b1ff1-e431-5cc7-8d20-acda43f29596', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cb06f6-b265-4770-947f-7bb331b8bce1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSwmIUok {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad84b096-90, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad84b096-90, col_values=(('qos', UUID('88fa54d1-5b40-4e00-9729-93e5f50b992d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad84b096-90, col_values=(('external_ids', {'iface-id': 'ad84b096-90e0-41f9-9baa-2bb79f9a9fb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:70:0f', 'vm-uuid': 'cb82677d-4aba-488b-a8f5-33ceada2c0e2'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSwmIUok" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:49 user nova-compute[75288]: INFO os_vif [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=ad84b096-90e0-41f9-9baa-2bb79f9a9fb4,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad84b096-90')
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f7ef06-df1d-4bfb-a651-daafa9e57776]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RSwmIUok'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[22315e38-7959-4b22-a8cc-74bdc851a07b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ae54e8-1299-4df9-a0a7-ee2a96929735]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:49 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:49 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No VIF found with MAC fa:16:3e:4a:70:0f, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0067d6f3-4b31-49d5-ba91-d6f710bb3b28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296, portal: 172.16.0.220,3260]
Dec 01 13:53:49 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296, portal: 172.16.0.220,3260] successful.
Dec 01 13:53:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bfd9be-cecd-4fce-9069-69d99b6f2fbc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd3424-8710-4e97-a3a8-654442b69a6f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:49 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:49 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:53:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:49 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:49 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:53:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.671s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaa3cf5-d423-4684-9596-d2f1d132ce27]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSwmIUok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-52171804-48a8-4399-b44c-59e166747490 req-c5e2a8d1-7d08-4e5b-ab05-32e0e7649193 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Updated VIF entry in instance network info cache for port ad84b096-90e0-41f9-9baa-2bb79f9a9fb4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-52171804-48a8-4399-b44c-59e166747490 req-c5e2a8d1-7d08-4e5b-ab05-32e0e7649193 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Updating instance_info_cache with network_info: [{"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-52171804-48a8-4399-b44c-59e166747490 req-c5e2a8d1-7d08-4e5b-ab05-32e0e7649193 service nova] Releasing lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-024d3bd8-f46f-4da0-bb38-e1f1119b622d req-a1c5bb34-4d20-4a12-a6cd-875bae76f0ad service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-024d3bd8-f46f-4da0-bb38-e1f1119b622d req-a1c5bb34-4d20-4a12-a6cd-875bae76f0ad service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-024d3bd8-f46f-4da0-bb38-e1f1119b622d req-a1c5bb34-4d20-4a12-a6cd-875bae76f0ad service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-024d3bd8-f46f-4da0-bb38-e1f1119b622d req-a1c5bb34-4d20-4a12-a6cd-875bae76f0ad service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-024d3bd8-f46f-4da0-bb38-e1f1119b622d req-a1c5bb34-4d20-4a12-a6cd-875bae76f0ad service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:50 user nova-compute[75288]: WARNING nova.compute.manager [req-024d3bd8-f46f-4da0-bb38-e1f1119b622d req-a1c5bb34-4d20-4a12-a6cd-875bae76f0ad service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state active and task_state rescuing.
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b3ac23c7-d658-4885-b70c-74ad573cdb55 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.710s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== connect_volume: return (1712ms) {'type': 'block', 'scsi_wwn': '26264316335373132', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264316335373132', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-679148964',display_name='tempest-TestVolumeBootPattern-server-679148964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-679148964',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-cdddi0x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:53:30Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=515aad26-e3ca-4046-84bb-d1aea072c04e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:20:43,bridge_name='br-int',has_traffic_filtering=True,id=5917cafb-8c56-4596-a17c-e6babc227cfe,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5917cafb-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lazy-loading 'pci_devices' on Instance uuid 515aad26-e3ca-4046-84bb-d1aea072c04e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:53:50 user nova-compute[75288]:   <uuid>515aad26-e3ca-4046-84bb-d1aea072c04e</uuid>
Dec 01 13:53:50 user nova-compute[75288]:   <name>instance-0000001d</name>
Dec 01 13:53:50 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:53:50 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:53:50 user nova-compute[75288]:   <metadata>
Dec 01 13:53:50 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:53:50 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:53:50 user nova-compute[75288]:       <nova:name>tempest-TestVolumeBootPattern-server-679148964</nova:name>
Dec 01 13:53:50 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:53:48</nova:creationTime>
Dec 01 13:53:50 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:53:50 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:53:50 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:53:50 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:53:50 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:53:50 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:53:50 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:53:50 user nova-compute[75288]:       <nova:owner>
Dec 01 13:53:50 user nova-compute[75288]:         <nova:user uuid="ab6a9e09550e42edac3c1e8a9112fbd1">tempest-TestVolumeBootPattern-367476607-project-member</nova:user>
Dec 01 13:53:50 user nova-compute[75288]:         <nova:project uuid="1120cc4cc3d8458aaf5755a500e994c6">tempest-TestVolumeBootPattern-367476607</nova:project>
Dec 01 13:53:50 user nova-compute[75288]:       </nova:owner>
Dec 01 13:53:50 user nova-compute[75288]:       <nova:ports>
Dec 01 13:53:50 user nova-compute[75288]:         <nova:port uuid="5917cafb-8c56-4596-a17c-e6babc227cfe">
Dec 01 13:53:50 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 13:53:50 user nova-compute[75288]:         </nova:port>
Dec 01 13:53:50 user nova-compute[75288]:       </nova:ports>
Dec 01 13:53:50 user nova-compute[75288]:     </nova:instance>
Dec 01 13:53:50 user nova-compute[75288]:   </metadata>
Dec 01 13:53:50 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:53:50 user nova-compute[75288]:     <system>
Dec 01 13:53:50 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:53:50 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:53:50 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:53:50 user nova-compute[75288]:       <entry name="serial">515aad26-e3ca-4046-84bb-d1aea072c04e</entry>
Dec 01 13:53:50 user nova-compute[75288]:       <entry name="uuid">515aad26-e3ca-4046-84bb-d1aea072c04e</entry>
Dec 01 13:53:50 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:53:50 user nova-compute[75288]:     </system>
Dec 01 13:53:50 user nova-compute[75288]:   </sysinfo>
Dec 01 13:53:50 user nova-compute[75288]:   <os>
Dec 01 13:53:50 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:53:50 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:53:50 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:53:50 user nova-compute[75288]:   </os>
Dec 01 13:53:50 user nova-compute[75288]:   <features>
Dec 01 13:53:50 user nova-compute[75288]:     <acpi/>
Dec 01 13:53:50 user nova-compute[75288]:     <apic/>
Dec 01 13:53:50 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:53:50 user nova-compute[75288]:   </features>
Dec 01 13:53:50 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:53:50 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:53:50 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:53:50 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:53:50 user nova-compute[75288]:   </clock>
Dec 01 13:53:50 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:53:50 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:53:50 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:53:50 user nova-compute[75288]:   </cpu>
Dec 01 13:53:50 user nova-compute[75288]:   <devices>
Dec 01 13:53:50 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:53:50 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:53:50 user nova-compute[75288]:       <source dev="/dev/sdd"/>
Dec 01 13:53:50 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:53:50 user nova-compute[75288]:       <serial>8d2f7a26-cde2-4580-904a-d649483cb296</serial>
Dec 01 13:53:50 user nova-compute[75288]:     </disk>
Dec 01 13:53:50 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:53:50 user nova-compute[75288]:       <mac address="fa:16:3e:f5:20:43"/>
Dec 01 13:53:50 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:50 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:53:50 user nova-compute[75288]:       <target dev="tap5917cafb-8c"/>
Dec 01 13:53:50 user nova-compute[75288]:     </interface>
Dec 01 13:53:50 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:53:50 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/515aad26-e3ca-4046-84bb-d1aea072c04e/console.log" append="off"/>
Dec 01 13:53:50 user nova-compute[75288]:     </serial>
Dec 01 13:53:50 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:53:50 user nova-compute[75288]:     <video>
Dec 01 13:53:50 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:50 user nova-compute[75288]:     </video>
Dec 01 13:53:50 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:53:50 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:53:50 user nova-compute[75288]:     </rng>
Dec 01 13:53:50 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:53:50 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:53:50 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:53:50 user nova-compute[75288]:     </memballoon>
Dec 01 13:53:50 user nova-compute[75288]:   </devices>
Dec 01 13:53:50 user nova-compute[75288]: </domain>
Dec 01 13:53:50 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-679148964',display_name='tempest-TestVolumeBootPattern-server-679148964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-679148964',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-cdddi0x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:53:30Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=515aad26-e3ca-4046-84bb-d1aea072c04e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:20:43,bridge_name='br-int',has_traffic_filtering=True,id=5917cafb-8c56-4596-a17c-e6babc227cfe,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5917cafb-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG os_vif [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:20:43,bridge_name='br-int',has_traffic_filtering=True,id=5917cafb-8c56-4596-a17c-e6babc227cfe,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5917cafb-8c') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38999310-54c0-5e16-9c05-756434fc6536', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5917cafb-8c, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5917cafb-8c, col_values=(('qos', UUID('16c8f87d-07ed-46c8-8174-503f441a99b0')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5917cafb-8c, col_values=(('external_ids', {'iface-id': '5917cafb-8c56-4596-a17c-e6babc227cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:20:43', 'vm-uuid': '515aad26-e3ca-4046-84bb-d1aea072c04e'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:50 user nova-compute[75288]: INFO os_vif [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:20:43,bridge_name='br-int',has_traffic_filtering=True,id=5917cafb-8c56-4596-a17c-e6babc227cfe,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5917cafb-8c')
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] No VIF found with MAC fa:16:3e:f5:20:43, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:53:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received event network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] No waiting events found dispatching network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:52 user nova-compute[75288]: WARNING nova.compute.manager [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received unexpected event network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 for instance with vm_state building and task_state spawning.
Dec 01 13:53:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received event network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] No waiting events found dispatching network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:52 user nova-compute[75288]: WARNING nova.compute.manager [req-53be2f74-294a-4f87-ad6e-309198b0dbd0 req-dc0cca21-18e2-41fd-9830-0d6e10dafb1e service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received unexpected event network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 for instance with vm_state building and task_state spawning.
Dec 01 13:53:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGQLcSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:53:52 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:53:52 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:53:52 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3245cda-eae3-49a2-9678-8513b2e89a23]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:53:52 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b941b2-6d31-4e13-a327-6cdf66495be2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef] added
Dec 01 13:53:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab791e66-ee7b-4a3d-baa0-412b4538e7c6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[024d4ab9-dfb9-41fd-a23c-3a8aba0b8fed]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJGQLcSP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aJGQLcSP" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ae235-20c8-4c95-a342-743885cc9a94]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aJGQLcSP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da9bdc-eca5-42f6-b420-e4fd61397163]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b814745-2cd2-4d55-87fd-68df4e993999]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:52 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:52 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:53:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:52 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:52 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:53:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d490a-42e1-4f96-9958-50eed7890577]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef, portal: 172.16.0.220,3260]
Dec 01 13:53:52 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef, portal: 172.16.0.220,3260] successful.
Dec 01 13:53:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e40dc5-d844-483d-893d-c76156aeab1e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[71526786-4467-4931-a62b-110cba87f320]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:53 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:53 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:53:53 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:53:53 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:53:53 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:53:53 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:53:53 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:53:53 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce5de53-725f-4ee1-b757-2694722ccff9]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:53:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGQLcSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26230643337623239', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230643337623239', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'flavor' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:53:54 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:53:54 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:53:54 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:53:54 user nova-compute[75288]:   <serial>e55ba83a-624c-4d40-b278-7d922c7a11ef</serial>
Dec 01 13:53:54 user nova-compute[75288]: </disk>
Dec 01 13:53:54 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] Acquiring lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] No waiting events found dispatching network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:54 user nova-compute[75288]: WARNING nova.compute.manager [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received unexpected event network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe for instance with vm_state building and task_state spawning.
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] Acquiring lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] No waiting events found dispatching network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:54 user nova-compute[75288]: WARNING nova.compute.manager [req-7580ff8d-6561-4a10-b370-3e05c4881bd6 req-f07e1afa-062e-4f9c-bf35-4a4f64b9714e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received unexpected event network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe for instance with vm_state building and task_state spawning.
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No VIF found with MAC fa:16:3e:97:73:e6, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39498f43-960b-48bd-81ef-d7aad2b2b1e7 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.238s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Instance spawned successfully.
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:55 user nova-compute[75288]: INFO nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Took 8.02 seconds to spawn the instance on the hypervisor.
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:53:55 user nova-compute[75288]: INFO nova.compute.manager [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Took 9.35 seconds to build instance.
Dec 01 13:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-39881370-8c99-4d70-bb30-d37baa1f920a tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.538s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:53:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Instance spawned successfully.
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:53:55 user nova-compute[75288]: INFO nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Took 6.63 seconds to spawn the instance on the hypervisor.
Dec 01 13:53:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:53:55 user nova-compute[75288]: INFO nova.compute.manager [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Took 26.14 seconds to build instance.
Dec 01 13:53:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e4eea479-3af4-4f5c-ac63-2a9b94233633 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.251s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:56 user nova-compute[75288]: INFO nova.compute.manager [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Rescuing
Dec 01 13:53:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:53:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquired lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:53:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:53:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating instance_info_cache with network_info: [{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:53:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Releasing lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-46e2c393-d601-47d1-814a-9e0483a694f8 req-7d7bf0ed-2f06-4d92-99f8-16b5189cb8ad service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46e2c393-d601-47d1-814a-9e0483a694f8 req-7d7bf0ed-2f06-4d92-99f8-16b5189cb8ad service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46e2c393-d601-47d1-814a-9e0483a694f8 req-7d7bf0ed-2f06-4d92-99f8-16b5189cb8ad service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-46e2c393-d601-47d1-814a-9e0483a694f8 req-7d7bf0ed-2f06-4d92-99f8-16b5189cb8ad service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-46e2c393-d601-47d1-814a-9e0483a694f8 req-7d7bf0ed-2f06-4d92-99f8-16b5189cb8ad service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:57 user nova-compute[75288]: WARNING nova.compute.manager [req-46e2c393-d601-47d1-814a-9e0483a694f8 req-7d7bf0ed-2f06-4d92-99f8-16b5189cb8ad service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state active and task_state rescuing.
Dec 01 13:53:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance destroyed successfully.
Dec 01 13:53:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Attempting rescue
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 13:53:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Creating image(s)
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'trusted_certs' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue" returned: 0 in 0.055s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'migration_context' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.objects.base [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<ce476b0b-4ed7-42bc-9801-860255953006> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Start _get_guest_xml network_info=[{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:97:73:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'resources' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.objects.base [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<ce476b0b-4ed7-42bc-9801-860255953006> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'numa_topology' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.objects.base [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<ce476b0b-4ed7-42bc-9801-860255953006> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:53:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<ce476b0b-4ed7-42bc-9801-860255953006> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-898293798',display_name='tempest-ServerRescueNegativeTestJSON-server-898293798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-898293798',id=26,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc+Zizx0KU4YIgWRQ6wHDhgCZOBALQjYZgThcvzgaIFKNJWrmPvHt6TgjzBkijrHh+TxA9UV8Hc5NU4XjlSUVtH/24/aJnonQPBZEjENsXJ+40B6nhvTSZl28U4GD/svg==',key_name='tempest-keypair-1111385212',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-7310x4vc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad75165194843718ebc8b886ab3b6b7',uuid=ce476b0b-4ed7-42bc-9801-860255953006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:97:73:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "vif_mac": "fa:16:3e:97:73:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=d2e3b708-7d4a-4339-880a-bfe8801dadc0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e3b708-7d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'pci_devices' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.objects.base [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Object Instance<ce476b0b-4ed7-42bc-9801-860255953006> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:53:58 user nova-compute[75288]:   <uuid>ce476b0b-4ed7-42bc-9801-860255953006</uuid>
Dec 01 13:53:58 user nova-compute[75288]:   <name>instance-0000001a</name>
Dec 01 13:53:58 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:53:58 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:53:58 user nova-compute[75288]:   <metadata>
Dec 01 13:53:58 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:53:58 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:53:58 user nova-compute[75288]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-898293798</nova:name>
Dec 01 13:53:58 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:53:57</nova:creationTime>
Dec 01 13:53:58 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:53:58 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:53:58 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:53:58 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:53:58 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:53:58 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:53:58 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:53:58 user nova-compute[75288]:       <nova:owner>
Dec 01 13:53:58 user nova-compute[75288]:         <nova:user uuid="cad75165194843718ebc8b886ab3b6b7">tempest-ServerRescueNegativeTestJSON-1340015149-project-member</nova:user>
Dec 01 13:53:58 user nova-compute[75288]:         <nova:project uuid="a5854339bf9c4f3db4a3bf2c65ddc344">tempest-ServerRescueNegativeTestJSON-1340015149</nova:project>
Dec 01 13:53:58 user nova-compute[75288]:       </nova:owner>
Dec 01 13:53:58 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:53:58 user nova-compute[75288]:       <nova:ports>
Dec 01 13:53:58 user nova-compute[75288]:         <nova:port uuid="d2e3b708-7d4a-4339-880a-bfe8801dadc0">
Dec 01 13:53:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 13:53:58 user nova-compute[75288]:         </nova:port>
Dec 01 13:53:58 user nova-compute[75288]:       </nova:ports>
Dec 01 13:53:58 user nova-compute[75288]:     </nova:instance>
Dec 01 13:53:58 user nova-compute[75288]:   </metadata>
Dec 01 13:53:58 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:53:58 user nova-compute[75288]:     <system>
Dec 01 13:53:58 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:53:58 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:53:58 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:53:58 user nova-compute[75288]:       <entry name="serial">ce476b0b-4ed7-42bc-9801-860255953006</entry>
Dec 01 13:53:58 user nova-compute[75288]:       <entry name="uuid">ce476b0b-4ed7-42bc-9801-860255953006</entry>
Dec 01 13:53:58 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:53:58 user nova-compute[75288]:     </system>
Dec 01 13:53:58 user nova-compute[75288]:   </sysinfo>
Dec 01 13:53:58 user nova-compute[75288]:   <os>
Dec 01 13:53:58 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:53:58 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:53:58 user nova-compute[75288]:   </os>
Dec 01 13:53:58 user nova-compute[75288]:   <features>
Dec 01 13:53:58 user nova-compute[75288]:     <acpi/>
Dec 01 13:53:58 user nova-compute[75288]:     <apic/>
Dec 01 13:53:58 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:53:58 user nova-compute[75288]:   </features>
Dec 01 13:53:58 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:53:58 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:53:58 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:53:58 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:53:58 user nova-compute[75288]:   </clock>
Dec 01 13:53:58 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:53:58 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:53:58 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:53:58 user nova-compute[75288]:   </cpu>
Dec 01 13:53:58 user nova-compute[75288]:   <devices>
Dec 01 13:53:58 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:53:58 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:53:58 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue"/>
Dec 01 13:53:58 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:53:58 user nova-compute[75288]:     </disk>
Dec 01 13:53:58 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:53:58 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:53:58 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk"/>
Dec 01 13:53:58 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 13:53:58 user nova-compute[75288]:     </disk>
Dec 01 13:53:58 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:53:58 user nova-compute[75288]:       <mac address="fa:16:3e:97:73:e6"/>
Dec 01 13:53:58 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:58 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:53:58 user nova-compute[75288]:       <target dev="tapd2e3b708-7d"/>
Dec 01 13:53:58 user nova-compute[75288]:     </interface>
Dec 01 13:53:58 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:53:58 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/console.log" append="off"/>
Dec 01 13:53:58 user nova-compute[75288]:     </serial>
Dec 01 13:53:58 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:53:58 user nova-compute[75288]:     <video>
Dec 01 13:53:58 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:53:58 user nova-compute[75288]:     </video>
Dec 01 13:53:58 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:53:58 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:53:58 user nova-compute[75288]:     </rng>
Dec 01 13:53:58 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:53:58 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:53:58 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:53:58 user nova-compute[75288]:     </memballoon>
Dec 01 13:53:58 user nova-compute[75288]:   </devices>
Dec 01 13:53:58 user nova-compute[75288]: </domain>
Dec 01 13:53:58 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:53:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance destroyed successfully.
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:53:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] No VIF found with MAC fa:16:3e:97:73:e6, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:53:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b0be79e-c614-4410-aa28-060f2aead935 req-782defbf-f88a-4508-bb1c-9d2e777fc5d2 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:53:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b0be79e-c614-4410-aa28-060f2aead935 req-782defbf-f88a-4508-bb1c-9d2e777fc5d2 service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:53:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b0be79e-c614-4410-aa28-060f2aead935 req-782defbf-f88a-4508-bb1c-9d2e777fc5d2 service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:53:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b0be79e-c614-4410-aa28-060f2aead935 req-782defbf-f88a-4508-bb1c-9d2e777fc5d2 service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:53:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b0be79e-c614-4410-aa28-060f2aead935 req-782defbf-f88a-4508-bb1c-9d2e777fc5d2 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:53:59 user nova-compute[75288]: WARNING nova.compute.manager [req-3b0be79e-c614-4410-aa28-060f2aead935 req-782defbf-f88a-4508-bb1c-9d2e777fc5d2 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state active and task_state rescuing.
Dec 01 13:53:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:53:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:00 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:54:01 user nova-compute[75288]: WARNING nova.compute.manager [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state active and task_state rescuing.
Dec 01 13:54:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:54:01 user nova-compute[75288]: WARNING nova.compute.manager [req-2d56a7ae-0336-4ae8-96bb-d7b878f2eed2 req-47fb3cfa-0268-4629-9961-b3a946a5f7ed service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state active and task_state rescuing.
Dec 01 13:54:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b0d85534-652c-40cd-98b1-71fc87fc7b35 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:54:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:07 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:10 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updating instance_info_cache with network_info: [{"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:11 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:54:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:16 user nova-compute[75288]: INFO nova.compute.manager [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Terminating instance
Dec 01 13:54:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-71a09c4e-b785-484f-8788-433ed19d7b6c req-95ecf07a-4031-4bd4-a63b-7525b9a7c663 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received event network-vif-unplugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71a09c4e-b785-484f-8788-433ed19d7b6c req-95ecf07a-4031-4bd4-a63b-7525b9a7c663 service nova] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71a09c4e-b785-484f-8788-433ed19d7b6c req-95ecf07a-4031-4bd4-a63b-7525b9a7c663 service nova] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-71a09c4e-b785-484f-8788-433ed19d7b6c req-95ecf07a-4031-4bd4-a63b-7525b9a7c663 service nova] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-71a09c4e-b785-484f-8788-433ed19d7b6c req-95ecf07a-4031-4bd4-a63b-7525b9a7c663 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] No waiting events found dispatching network-vif-unplugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-71a09c4e-b785-484f-8788-433ed19d7b6c req-95ecf07a-4031-4bd4-a63b-7525b9a7c663 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received event network-vif-unplugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Instance destroyed successfully.
Dec 01 13:54:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lazy-loading 'resources' on Instance uuid a429ddc9-a5d9-460a-aac1-e7a27d7861ae {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1172254663',display_name='tempest-TestServerVolumeAttachmentScenario-server-1172254663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1172254663',id=23,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9t/426wiARJAv1GIUQ8pGEbfWmBRRjHo5E8D3wSC21i47JBBRfs6K6Hwd9aAZjrCCf8nLYQuLnn71JTC7X1YKKIuHuibd3/fA8iPmBrSGVzzIwOlU8ZDPgjCKohLnVZQ==',key_name='tempest-keypair-2025891063',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4860422c7dcb48289f15161dacb1e9d5',ramdisk_id='',reservation_id='r-awrzrybj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-175544438',owner_user_name='tempest-TestServerVolumeAttachmentScenario-175544438-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:50:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a771f5164ca349fd9c3ffcc0f0961442',uuid=a429ddc9-a5d9-460a-aac1-e7a27d7861ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Converting VIF {"id": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "address": "fa:16:3e:81:fd:79", "network": {"id": "02b307db-737c-434d-97d6-84d3872d535b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1538831627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4860422c7dcb48289f15161dacb1e9d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d8af2ea-81", "ovs_interfaceid": "6d8af2ea-8107-40d1-9f46-2610d8e3e026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:fd:79,bridge_name='br-int',has_traffic_filtering=True,id=6d8af2ea-8107-40d1-9f46-2610d8e3e026,network=Network(02b307db-737c-434d-97d6-84d3872d535b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8af2ea-81') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG os_vif [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:fd:79,bridge_name='br-int',has_traffic_filtering=True,id=6d8af2ea-8107-40d1-9f46-2610d8e3e026,network=Network(02b307db-737c-434d-97d6-84d3872d535b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8af2ea-81') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d8af2ea-81, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb2d1ac1-9fce-477f-83e5-c0b0bb9b9078) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:16 user nova-compute[75288]: INFO os_vif [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:fd:79,bridge_name='br-int',has_traffic_filtering=True,id=6d8af2ea-8107-40d1-9f46-2610d8e3e026,network=Network(02b307db-737c-434d-97d6-84d3872d535b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d8af2ea-81')
Dec 01 13:54:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Deleting instance files /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae_del
Dec 01 13:54:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Deletion of /opt/stack/data/nova/instances/a429ddc9-a5d9-460a-aac1-e7a27d7861ae_del complete
Dec 01 13:54:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:17 user nova-compute[75288]: INFO nova.compute.manager [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 01 13:54:17 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:54:17 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:54:17 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:54:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:54:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:54:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7026MB free_disk=25.106765747070312GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:54:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ce476b0b-4ed7-42bc-9801-860255953006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0643ed1e-37b9-4a4b-b260-c9dc602190ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 515aad26-e3ca-4046-84bb-d1aea072c04e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d175885c-b192-4e34-b48c-33cd3809076e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing inventories for resource provider 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating ProviderTree inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing aggregate associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing trait associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:54:18 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Took 1.22 seconds to deallocate network for instance.
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-a21f545a-bb4c-4525-8fc3-cc25baf90df6 req-ab95d8da-c434-484e-9028-488bc971747a service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received event network-vif-deleted-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:18 user nova-compute[75288]: INFO nova.compute.manager [req-a21f545a-bb4c-4525-8fc3-cc25baf90df6 req-ab95d8da-c434-484e-9028-488bc971747a service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Neutron deleted interface 6d8af2ea-8107-40d1-9f46-2610d8e3e026; detaching it from the instance and deleting it from the info cache
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-a21f545a-bb4c-4525-8fc3-cc25baf90df6 req-ab95d8da-c434-484e-9028-488bc971747a service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-a21f545a-bb4c-4525-8fc3-cc25baf90df6 req-ab95d8da-c434-484e-9028-488bc971747a service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Detach interface failed, port_id=6d8af2ea-8107-40d1-9f46-2610d8e3e026, reason: Instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-34743b57-ee7b-4b1a-9a23-b3a884627182 req-4afed58f-29c9-4bb6-94f5-f89c73755c00 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received event network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-34743b57-ee7b-4b1a-9a23-b3a884627182 req-4afed58f-29c9-4bb6-94f5-f89c73755c00 service nova] Acquiring lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-34743b57-ee7b-4b1a-9a23-b3a884627182 req-4afed58f-29c9-4bb6-94f5-f89c73755c00 service nova] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-34743b57-ee7b-4b1a-9a23-b3a884627182 req-4afed58f-29c9-4bb6-94f5-f89c73755c00 service nova] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-34743b57-ee7b-4b1a-9a23-b3a884627182 req-4afed58f-29c9-4bb6-94f5-f89c73755c00 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] No waiting events found dispatching network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:54:18 user nova-compute[75288]: WARNING nova.compute.manager [req-34743b57-ee7b-4b1a-9a23-b3a884627182 req-4afed58f-29c9-4bb6-94f5-f89c73755c00 service nova] [instance: a429ddc9-a5d9-460a-aac1-e7a27d7861ae] Received unexpected event network-vif-plugged-6d8af2ea-8107-40d1-9f46-2610d8e3e026 for instance with vm_state deleted and task_state None.
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.192s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.536s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 13:54:19 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:54:19 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:54:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:19 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Deleted allocations for instance a429ddc9-a5d9-460a-aac1-e7a27d7861ae
Dec 01 13:54:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43c0498b-2b1f-4206-8cd4-9f9ff35107e5 tempest-TestServerVolumeAttachmentScenario-175544438 tempest-TestServerVolumeAttachmentScenario-175544438-project-member] Lock "a429ddc9-a5d9-460a-aac1-e7a27d7861ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.433s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:54:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:54:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 13:54:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 13:54:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance has had 2 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Dec 01 13:54:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Deletion of /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize failed
Dec 01 13:54:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:34 user nova-compute[75288]: INFO nova.compute.manager [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Terminating instance
Dec 01 13:54:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:54:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-f1e53474-73db-4868-ae2b-11cb536d592f req-865d63f5-fbc5-424d-91a0-53882e5a3dbb service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received event network-vif-unplugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f1e53474-73db-4868-ae2b-11cb536d592f req-865d63f5-fbc5-424d-91a0-53882e5a3dbb service nova] Acquiring lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f1e53474-73db-4868-ae2b-11cb536d592f req-865d63f5-fbc5-424d-91a0-53882e5a3dbb service nova] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f1e53474-73db-4868-ae2b-11cb536d592f req-865d63f5-fbc5-424d-91a0-53882e5a3dbb service nova] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-f1e53474-73db-4868-ae2b-11cb536d592f req-865d63f5-fbc5-424d-91a0-53882e5a3dbb service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] No waiting events found dispatching network-vif-unplugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-f1e53474-73db-4868-ae2b-11cb536d592f req-865d63f5-fbc5-424d-91a0-53882e5a3dbb service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received event network-vif-unplugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Instance destroyed successfully.
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.objects.instance [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lazy-loading 'resources' on Instance uuid 0643ed1e-37b9-4a4b-b260-c9dc602190ab {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-593156575',display_name='tempest-ServersNegativeTestJSON-server-593156575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-593156575',id=28,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:52:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d51003ff129d43df8b28f33bae48350c',ramdisk_id='',reservation_id='r-qd0m7wju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1610504678',owner_user_name='tempest-ServersNegativeTestJSON-1610504678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:52:52Z,user_data=None,user_id='e299489ce6ea49ba9fd3bd83a44002c4',uuid=0643ed1e-37b9-4a4b-b260-c9dc602190ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converting VIF {"id": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "address": "fa:16:3e:b4:3d:97", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd3ac39-ea", "ovs_interfaceid": "9cd3ac39-ea4d-478d-a403-a77ee9e8296b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:3d:97,bridge_name='br-int',has_traffic_filtering=True,id=9cd3ac39-ea4d-478d-a403-a77ee9e8296b,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd3ac39-ea') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG os_vif [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:3d:97,bridge_name='br-int',has_traffic_filtering=True,id=9cd3ac39-ea4d-478d-a403-a77ee9e8296b,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd3ac39-ea') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cd3ac39-ea, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cb77fdc-fa72-4dc7-9865-7fcab9d974f9) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:54:35 user nova-compute[75288]: INFO os_vif [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:3d:97,bridge_name='br-int',has_traffic_filtering=True,id=9cd3ac39-ea4d-478d-a403-a77ee9e8296b,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd3ac39-ea')
Dec 01 13:54:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Deleting instance files /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab_del
Dec 01 13:54:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Deletion of /opt/stack/data/nova/instances/0643ed1e-37b9-4a4b-b260-c9dc602190ab_del complete
Dec 01 13:54:35 user nova-compute[75288]: INFO nova.compute.manager [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Took 0.71 seconds to destroy the instance on the hypervisor.
Dec 01 13:54:35 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:54:35 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:54:36 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:54:36 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Took 0.49 seconds to deallocate network for instance.
Dec 01 13:54:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-a57a159b-0815-4836-9a5c-eec93fb3fcf7 req-2bbe0ed3-4673-478b-9d9a-aff71d396c6b service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received event network-vif-deleted-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:36 user nova-compute[75288]: INFO nova.compute.manager [req-a57a159b-0815-4836-9a5c-eec93fb3fcf7 req-2bbe0ed3-4673-478b-9d9a-aff71d396c6b service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Neutron deleted interface 9cd3ac39-ea4d-478d-a403-a77ee9e8296b; detaching it from the instance and deleting it from the info cache
Dec 01 13:54:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-a57a159b-0815-4836-9a5c-eec93fb3fcf7 req-2bbe0ed3-4673-478b-9d9a-aff71d396c6b service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:54:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-a57a159b-0815-4836-9a5c-eec93fb3fcf7 req-2bbe0ed3-4673-478b-9d9a-aff71d396c6b service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Detach interface failed, port_id=9cd3ac39-ea4d-478d-a403-a77ee9e8296b, reason: Instance 0643ed1e-37b9-4a4b-b260-c9dc602190ab could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:36 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:54:36 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:36 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Deleted allocations for instance 0643ed1e-37b9-4a4b-b260-c9dc602190ab
Dec 01 13:54:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-c92e6636-965c-4fb5-91c2-f117eb689327 tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.796s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-b627a58e-a6e6-4742-8cdf-b52b2d978d97 req-d5915e2b-6337-486e-a4ab-fc154da99556 service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received event network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b627a58e-a6e6-4742-8cdf-b52b2d978d97 req-d5915e2b-6337-486e-a4ab-fc154da99556 service nova] Acquiring lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b627a58e-a6e6-4742-8cdf-b52b2d978d97 req-d5915e2b-6337-486e-a4ab-fc154da99556 service nova] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b627a58e-a6e6-4742-8cdf-b52b2d978d97 req-d5915e2b-6337-486e-a4ab-fc154da99556 service nova] Lock "0643ed1e-37b9-4a4b-b260-c9dc602190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-b627a58e-a6e6-4742-8cdf-b52b2d978d97 req-d5915e2b-6337-486e-a4ab-fc154da99556 service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] No waiting events found dispatching network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:54:37 user nova-compute[75288]: WARNING nova.compute.manager [req-b627a58e-a6e6-4742-8cdf-b52b2d978d97 req-d5915e2b-6337-486e-a4ab-fc154da99556 service nova] [instance: 0643ed1e-37b9-4a4b-b260-c9dc602190ab] Received unexpected event network-vif-plugged-9cd3ac39-ea4d-478d-a403-a77ee9e8296b for instance with vm_state deleted and task_state None.
Dec 01 13:54:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:54:46 user nova-compute[75288]: INFO nova.compute.claims [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Claim successful on node user
Dec 01 13:54:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:54:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:54:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG nova.policy [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a8b600efb9d47b6991cbde8b34b9a1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85fa93e7dad94355a81ee3193a26d19a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:54:47 user nova-compute[75288]: INFO nova.virt.block_device [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Booting with volume 5d75223d-31e1-4691-98bd-d039f7ec5260 at /dev/vda
Dec 01 13:54:47 user nova-compute[75288]: DEBUG os_brick.utils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d02bffe-a7c1-49b5-b2c1-e6aef379677e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[030ef856-b7d1-4fd5-a3d3-eab1fe148c8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d37d9aa-b6bc-4102-a0f5-ef3cf110d2ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a8ee46-ff81-42ad-941b-708aa5feb39d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:54:47 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:54:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bcaae7-9a47-45de-8e4f-e38865857064]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG os_brick.utils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating existing volume attachment record: 30c4d20c-27b0-4b96-8731-bc51ccf36cff {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Successfully created port: 830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:54:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Successfully updated port: 830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:54:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:54:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquired lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:54:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:54:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-60183b65-dcaa-4a2a-9fe2-8652383c349b req-035dcb83-e887-46cd-810c-cd7dd29c3914 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-changed-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:54:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-60183b65-dcaa-4a2a-9fe2-8652383c349b req-035dcb83-e887-46cd-810c-cd7dd29c3914 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Refreshing instance network info cache due to event network-changed-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:54:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60183b65-dcaa-4a2a-9fe2-8652383c349b req-035dcb83-e887-46cd-810c-cd7dd29c3914 service nova] Acquiring lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating instance_info_cache with network_info: [{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Releasing lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance network_info: |[{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60183b65-dcaa-4a2a-9fe2-8652383c349b req-035dcb83-e887-46cd-810c-cd7dd29c3914 service nova] Acquired lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-60183b65-dcaa-4a2a-9fe2-8652383c349b req-035dcb83-e887-46cd-810c-cd7dd29c3914 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Refreshing network info cache for port 830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-60183b65-dcaa-4a2a-9fe2-8652383c349b req-035dcb83-e887-46cd-810c-cd7dd29c3914 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Updated VIF entry in instance network info cache for port 830b3d65-26cd-4266-a4a7-67dd9cf6dd5b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-60183b65-dcaa-4a2a-9fe2-8652383c349b req-035dcb83-e887-46cd-810c-cd7dd29c3914 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating instance_info_cache with network_info: [{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:54:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60183b65-dcaa-4a2a-9fe2-8652383c349b req-035dcb83-e887-46cd-810c-cd7dd29c3914 service nova] Releasing lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:54:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:54:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Creating image(s)
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Ensure instance console log exists: /opt/stack/data/nova/instances/b4211312-8a32-4723-801d-47c3db348668/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Start _get_guest_xml network_info=[{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '30c4d20c-27b0-4b96-8731-bc51ccf36cff', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjbTQnir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4211312-8a32-4723-801d-47c3db348668', 'attached_at': '', 'detached_at': '', 'volume_id': '5d75223d-31e1-4691-98bd-d039f7ec5260', 'serial': '5d75223d-31e1-4691-98bd-d039f7ec5260'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:54:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjbTQnir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:54:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:54:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:54:57 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de6cd96-2103-482b-89ce-1deb6fa9d40c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:54:57 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e76dba4-1d2d-498d-9acf-1742c89f0169]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260] added
Dec 01 13:54:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfb5966-0200-4dff-9595-0205a5917d1c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e719af9-6f48-446e-b6a1-82b1b169effe]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjbTQnir {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjbTQnir" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b62443e-438e-475c-8b7e-0d0eec358a79]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjbTQnir'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da520615-3401-4a42-91b1-5d7f3b7fdf2f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aca1a5-00be-4192-bbac-35fc4e7b147c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:54:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:54:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be010ddf-73ea-4676-85eb-519dbb568238]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260]
Dec 01 13:54:57 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260] successful.
Dec 01 13:54:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2971e2fd-d2ed-479c-8188-0e801a54ebb2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f5d44-91d5-4200-b408-ff9ccd521026]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:54:57 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:54:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[59620b8c-e627-4095-9b23-7ad100997068]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:54:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjbTQnir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23630336161323237', 'path': '/dev/sdf'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630336161323237', 'path': '/dev/sdf'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1258491341',display_name='tempest-ServerActionsTestOtherA-server-1258491341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1258491341',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-75q0eqf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=b4211312-8a32-4723-801d-47c3db348668,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'pci_devices' on Instance uuid b4211312-8a32-4723-801d-47c3db348668 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:54:58 user nova-compute[75288]:   <uuid>b4211312-8a32-4723-801d-47c3db348668</uuid>
Dec 01 13:54:58 user nova-compute[75288]:   <name>instance-00000020</name>
Dec 01 13:54:58 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:54:58 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:54:58 user nova-compute[75288]:   <metadata>
Dec 01 13:54:58 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:54:58 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:54:58 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherA-server-1258491341</nova:name>
Dec 01 13:54:58 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:54:57</nova:creationTime>
Dec 01 13:54:58 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:54:58 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:54:58 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:54:58 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:54:58 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:54:58 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:54:58 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:54:58 user nova-compute[75288]:       <nova:owner>
Dec 01 13:54:58 user nova-compute[75288]:         <nova:user uuid="5a8b600efb9d47b6991cbde8b34b9a1f">tempest-ServerActionsTestOtherA-1200563250-project-member</nova:user>
Dec 01 13:54:58 user nova-compute[75288]:         <nova:project uuid="85fa93e7dad94355a81ee3193a26d19a">tempest-ServerActionsTestOtherA-1200563250</nova:project>
Dec 01 13:54:58 user nova-compute[75288]:       </nova:owner>
Dec 01 13:54:58 user nova-compute[75288]:       <nova:ports>
Dec 01 13:54:58 user nova-compute[75288]:         <nova:port uuid="830b3d65-26cd-4266-a4a7-67dd9cf6dd5b">
Dec 01 13:54:58 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 13:54:58 user nova-compute[75288]:         </nova:port>
Dec 01 13:54:58 user nova-compute[75288]:       </nova:ports>
Dec 01 13:54:58 user nova-compute[75288]:     </nova:instance>
Dec 01 13:54:58 user nova-compute[75288]:   </metadata>
Dec 01 13:54:58 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:54:58 user nova-compute[75288]:     <system>
Dec 01 13:54:58 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:54:58 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:54:58 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:54:58 user nova-compute[75288]:       <entry name="serial">b4211312-8a32-4723-801d-47c3db348668</entry>
Dec 01 13:54:58 user nova-compute[75288]:       <entry name="uuid">b4211312-8a32-4723-801d-47c3db348668</entry>
Dec 01 13:54:58 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:54:58 user nova-compute[75288]:     </system>
Dec 01 13:54:58 user nova-compute[75288]:   </sysinfo>
Dec 01 13:54:58 user nova-compute[75288]:   <os>
Dec 01 13:54:58 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:54:58 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:54:58 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:54:58 user nova-compute[75288]:   </os>
Dec 01 13:54:58 user nova-compute[75288]:   <features>
Dec 01 13:54:58 user nova-compute[75288]:     <acpi/>
Dec 01 13:54:58 user nova-compute[75288]:     <apic/>
Dec 01 13:54:58 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:54:58 user nova-compute[75288]:   </features>
Dec 01 13:54:58 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:54:58 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:54:58 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:54:58 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:54:58 user nova-compute[75288]:   </clock>
Dec 01 13:54:58 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:54:58 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:54:58 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:54:58 user nova-compute[75288]:   </cpu>
Dec 01 13:54:58 user nova-compute[75288]:   <devices>
Dec 01 13:54:58 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:54:58 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:54:58 user nova-compute[75288]:       <source dev="/dev/sdf"/>
Dec 01 13:54:58 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:54:58 user nova-compute[75288]:       <serial>5d75223d-31e1-4691-98bd-d039f7ec5260</serial>
Dec 01 13:54:58 user nova-compute[75288]:     </disk>
Dec 01 13:54:58 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:54:58 user nova-compute[75288]:       <mac address="fa:16:3e:35:47:eb"/>
Dec 01 13:54:58 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:54:58 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:54:58 user nova-compute[75288]:       <target dev="tap830b3d65-26"/>
Dec 01 13:54:58 user nova-compute[75288]:     </interface>
Dec 01 13:54:58 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:54:58 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b4211312-8a32-4723-801d-47c3db348668/console.log" append="off"/>
Dec 01 13:54:58 user nova-compute[75288]:     </serial>
Dec 01 13:54:58 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:54:58 user nova-compute[75288]:     <video>
Dec 01 13:54:58 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:54:58 user nova-compute[75288]:     </video>
Dec 01 13:54:58 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:54:58 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:54:58 user nova-compute[75288]:     </rng>
Dec 01 13:54:58 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:54:58 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:54:58 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:54:58 user nova-compute[75288]:     </memballoon>
Dec 01 13:54:58 user nova-compute[75288]:   </devices>
Dec 01 13:54:58 user nova-compute[75288]: </domain>
Dec 01 13:54:58 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1258491341',display_name='tempest-ServerActionsTestOtherA-server-1258491341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1258491341',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-75q0eqf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=b4211312-8a32-4723-801d-47c3db348668,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG os_vif [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f813952d-79ad-5b2b-8cee-46a8ad290f19', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap830b3d65-26, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap830b3d65-26, col_values=(('qos', UUID('e01fcd19-3b2a-41d6-a90a-ee1959c91417')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap830b3d65-26, col_values=(('external_ids', {'iface-id': '830b3d65-26cd-4266-a4a7-67dd9cf6dd5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:47:eb', 'vm-uuid': 'b4211312-8a32-4723-801d-47c3db348668'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:54:58 user nova-compute[75288]: INFO os_vif [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26')
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:54:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No VIF found with MAC fa:16:3e:35:47:eb, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-d33d5f5c-4415-43e8-a0f5-c0c8034a4a35 req-2193fb11-0b3d-4ea0-a568-a0ec1094c24d service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d33d5f5c-4415-43e8-a0f5-c0c8034a4a35 req-2193fb11-0b3d-4ea0-a568-a0ec1094c24d service nova] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d33d5f5c-4415-43e8-a0f5-c0c8034a4a35 req-2193fb11-0b3d-4ea0-a568-a0ec1094c24d service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d33d5f5c-4415-43e8-a0f5-c0c8034a4a35 req-2193fb11-0b3d-4ea0-a568-a0ec1094c24d service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-d33d5f5c-4415-43e8-a0f5-c0c8034a4a35 req-2193fb11-0b3d-4ea0-a568-a0ec1094c24d service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] No waiting events found dispatching network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:00 user nova-compute[75288]: WARNING nova.compute.manager [req-d33d5f5c-4415-43e8-a0f5-c0c8034a4a35 req-2193fb11-0b3d-4ea0-a568-a0ec1094c24d service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received unexpected event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b for instance with vm_state building and task_state spawning.
Dec 01 13:55:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:55:02 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance spawned successfully.
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:02 user nova-compute[75288]: INFO nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Took 5.20 seconds to spawn the instance on the hypervisor.
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-54f32586-78e3-4776-9864-102f4ca5bd4c req-5b93e0eb-0d62-4f7c-9ca7-2ecf343b932d service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-54f32586-78e3-4776-9864-102f4ca5bd4c req-5b93e0eb-0d62-4f7c-9ca7-2ecf343b932d service nova] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-54f32586-78e3-4776-9864-102f4ca5bd4c req-5b93e0eb-0d62-4f7c-9ca7-2ecf343b932d service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-54f32586-78e3-4776-9864-102f4ca5bd4c req-5b93e0eb-0d62-4f7c-9ca7-2ecf343b932d service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-54f32586-78e3-4776-9864-102f4ca5bd4c req-5b93e0eb-0d62-4f7c-9ca7-2ecf343b932d service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] No waiting events found dispatching network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:02 user nova-compute[75288]: WARNING nova.compute.manager [req-54f32586-78e3-4776-9864-102f4ca5bd4c req-5b93e0eb-0d62-4f7c-9ca7-2ecf343b932d service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received unexpected event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b for instance with vm_state building and task_state spawning.
Dec 01 13:55:02 user nova-compute[75288]: INFO nova.compute.manager [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Took 16.23 seconds to build instance.
Dec 01 13:55:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7debc51c-70cf-4721-a851-2b24e8739592 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.354s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:05 user nova-compute[75288]: DEBUG nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:55:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:05 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:55:05 user nova-compute[75288]: INFO nova.compute.claims [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Claim successful on node user
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:55:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.policy [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35b2de5a7fb5488ba4e0e6204e730a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265995abf58f45f3bbcf9a9763b30f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:55:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Creating image(s)
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "/opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "/opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "/opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk 1073741824" returned: 0 in 0.052s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:06 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Cannot resize image /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Ensure instance console log exists: /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:07 user nova-compute[75288]: DEBUG nova.network.neutron [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Successfully created port: dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Successfully updated port: dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquired lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-6381db13-626e-47f2-9313-88e8cb799461 req-d551bcbc-9e7c-4d0f-8409-675d0763a313 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-changed-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-6381db13-626e-47f2-9313-88e8cb799461 req-d551bcbc-9e7c-4d0f-8409-675d0763a313 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Refreshing instance network info cache due to event network-changed-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6381db13-626e-47f2-9313-88e8cb799461 req-d551bcbc-9e7c-4d0f-8409-675d0763a313 service nova] Acquiring lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.neutron [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updating instance_info_cache with network_info: [{"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Releasing lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Instance network_info: |[{"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6381db13-626e-47f2-9313-88e8cb799461 req-d551bcbc-9e7c-4d0f-8409-675d0763a313 service nova] Acquired lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-6381db13-626e-47f2-9313-88e8cb799461 req-d551bcbc-9e7c-4d0f-8409-675d0763a313 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Refreshing network info cache for port dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Start _get_guest_xml network_info=[{"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:55:08 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:55:08 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2106884728',display_name='tempest-TestStampPattern-server-2106884728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2106884728',id=33,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL+EHm/xpEHocK4PGywUkdMgPUm3PvVQCZAtgnyMweWmGc4EZJmIRhcUDceKjjDUHaGiGhpCbY1eWeuL2sbOcyDf9YOZ/RySTwVTw18QS5oHeN1VGNdG51gHPory5yiNw==',key_name='tempest-TestStampPattern-1491628277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265995abf58f45f3bbcf9a9763b30f7c',ramdisk_id='',reservation_id='r-zq1jck45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1525886470',owner_user_name='tempest-TestStampPattern-1525886470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:55:06Z,user_data=None,user_id='35b2de5a7fb5488ba4e0e6204e730a97',uuid=60ed46b9-cae1-4bd5-bd37-6fdada399023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converting VIF {"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:90,bridge_name='br-int',has_traffic_filtering=True,id=dd2bd589-71cc-43dd-929f-8ccc0cb15d5e,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd2bd589-71') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.objects.instance [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'pci_devices' on Instance uuid 60ed46b9-cae1-4bd5-bd37-6fdada399023 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:55:08 user nova-compute[75288]:   <uuid>60ed46b9-cae1-4bd5-bd37-6fdada399023</uuid>
Dec 01 13:55:08 user nova-compute[75288]:   <name>instance-00000021</name>
Dec 01 13:55:08 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:55:08 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:55:08 user nova-compute[75288]:   <metadata>
Dec 01 13:55:08 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:55:08 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:55:08 user nova-compute[75288]:       <nova:name>tempest-TestStampPattern-server-2106884728</nova:name>
Dec 01 13:55:08 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:55:08</nova:creationTime>
Dec 01 13:55:08 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:55:08 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:55:08 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:55:08 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:55:08 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:55:08 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:55:08 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:55:08 user nova-compute[75288]:       <nova:owner>
Dec 01 13:55:08 user nova-compute[75288]:         <nova:user uuid="35b2de5a7fb5488ba4e0e6204e730a97">tempest-TestStampPattern-1525886470-project-member</nova:user>
Dec 01 13:55:08 user nova-compute[75288]:         <nova:project uuid="265995abf58f45f3bbcf9a9763b30f7c">tempest-TestStampPattern-1525886470</nova:project>
Dec 01 13:55:08 user nova-compute[75288]:       </nova:owner>
Dec 01 13:55:08 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:55:08 user nova-compute[75288]:       <nova:ports>
Dec 01 13:55:08 user nova-compute[75288]:         <nova:port uuid="dd2bd589-71cc-43dd-929f-8ccc0cb15d5e">
Dec 01 13:55:08 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 13:55:08 user nova-compute[75288]:         </nova:port>
Dec 01 13:55:08 user nova-compute[75288]:       </nova:ports>
Dec 01 13:55:08 user nova-compute[75288]:     </nova:instance>
Dec 01 13:55:08 user nova-compute[75288]:   </metadata>
Dec 01 13:55:08 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:55:08 user nova-compute[75288]:     <system>
Dec 01 13:55:08 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:55:08 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:55:08 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:55:08 user nova-compute[75288]:       <entry name="serial">60ed46b9-cae1-4bd5-bd37-6fdada399023</entry>
Dec 01 13:55:08 user nova-compute[75288]:       <entry name="uuid">60ed46b9-cae1-4bd5-bd37-6fdada399023</entry>
Dec 01 13:55:08 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:55:08 user nova-compute[75288]:     </system>
Dec 01 13:55:08 user nova-compute[75288]:   </sysinfo>
Dec 01 13:55:08 user nova-compute[75288]:   <os>
Dec 01 13:55:08 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:55:08 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:55:08 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:55:08 user nova-compute[75288]:   </os>
Dec 01 13:55:08 user nova-compute[75288]:   <features>
Dec 01 13:55:08 user nova-compute[75288]:     <acpi/>
Dec 01 13:55:08 user nova-compute[75288]:     <apic/>
Dec 01 13:55:08 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:55:08 user nova-compute[75288]:   </features>
Dec 01 13:55:08 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:55:08 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:55:08 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:55:08 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:55:08 user nova-compute[75288]:   </clock>
Dec 01 13:55:08 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:55:08 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:55:08 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:55:08 user nova-compute[75288]:   </cpu>
Dec 01 13:55:08 user nova-compute[75288]:   <devices>
Dec 01 13:55:08 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:55:08 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:55:08 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk"/>
Dec 01 13:55:08 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:55:08 user nova-compute[75288]:     </disk>
Dec 01 13:55:08 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:55:08 user nova-compute[75288]:       <mac address="fa:16:3e:79:15:90"/>
Dec 01 13:55:08 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:55:08 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:55:08 user nova-compute[75288]:       <target dev="tapdd2bd589-71"/>
Dec 01 13:55:08 user nova-compute[75288]:     </interface>
Dec 01 13:55:08 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:55:08 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/console.log" append="off"/>
Dec 01 13:55:08 user nova-compute[75288]:     </serial>
Dec 01 13:55:08 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:55:08 user nova-compute[75288]:     <video>
Dec 01 13:55:08 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:55:08 user nova-compute[75288]:     </video>
Dec 01 13:55:08 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:55:08 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:55:08 user nova-compute[75288]:     </rng>
Dec 01 13:55:08 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:55:08 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:55:08 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:55:08 user nova-compute[75288]:     </memballoon>
Dec 01 13:55:08 user nova-compute[75288]:   </devices>
Dec 01 13:55:08 user nova-compute[75288]: </domain>
Dec 01 13:55:08 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2106884728',display_name='tempest-TestStampPattern-server-2106884728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2106884728',id=33,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL+EHm/xpEHocK4PGywUkdMgPUm3PvVQCZAtgnyMweWmGc4EZJmIRhcUDceKjjDUHaGiGhpCbY1eWeuL2sbOcyDf9YOZ/RySTwVTw18QS5oHeN1VGNdG51gHPory5yiNw==',key_name='tempest-TestStampPattern-1491628277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265995abf58f45f3bbcf9a9763b30f7c',ramdisk_id='',reservation_id='r-zq1jck45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1525886470',owner_user_name='tempest-TestStampPattern-1525886470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:55:06Z,user_data=None,user_id='35b2de5a7fb5488ba4e0e6204e730a97',uuid=60ed46b9-cae1-4bd5-bd37-6fdada399023,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converting VIF {"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:90,bridge_name='br-int',has_traffic_filtering=True,id=dd2bd589-71cc-43dd-929f-8ccc0cb15d5e,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd2bd589-71') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG os_vif [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:90,bridge_name='br-int',has_traffic_filtering=True,id=dd2bd589-71cc-43dd-929f-8ccc0cb15d5e,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd2bd589-71') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b039707-97c5-583d-af39-9a1302efb21b', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd2bd589-71, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd2bd589-71, col_values=(('qos', UUID('9abc780f-e875-4ade-9551-ec29bbfae806')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd2bd589-71, col_values=(('external_ids', {'iface-id': 'dd2bd589-71cc-43dd-929f-8ccc0cb15d5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:15:90', 'vm-uuid': '60ed46b9-cae1-4bd5-bd37-6fdada399023'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:08 user nova-compute[75288]: INFO os_vif [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:15:90,bridge_name='br-int',has_traffic_filtering=True,id=dd2bd589-71cc-43dd-929f-8ccc0cb15d5e,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd2bd589-71')
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No VIF found with MAC fa:16:3e:79:15:90, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-6381db13-626e-47f2-9313-88e8cb799461 req-d551bcbc-9e7c-4d0f-8409-675d0763a313 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updated VIF entry in instance network info cache for port dd2bd589-71cc-43dd-929f-8ccc0cb15d5e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-6381db13-626e-47f2-9313-88e8cb799461 req-d551bcbc-9e7c-4d0f-8409-675d0763a313 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updating instance_info_cache with network_info: [{"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6381db13-626e-47f2-9313-88e8cb799461 req-d551bcbc-9e7c-4d0f-8409-675d0763a313 service nova] Releasing lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-8344c9b9-4fff-4d06-8bbf-719ccc7bff83 req-bd95b479-6028-4947-8b99-ab55aebf8d4c service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8344c9b9-4fff-4d06-8bbf-719ccc7bff83 req-bd95b479-6028-4947-8b99-ab55aebf8d4c service nova] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8344c9b9-4fff-4d06-8bbf-719ccc7bff83 req-bd95b479-6028-4947-8b99-ab55aebf8d4c service nova] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8344c9b9-4fff-4d06-8bbf-719ccc7bff83 req-bd95b479-6028-4947-8b99-ab55aebf8d4c service nova] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-8344c9b9-4fff-4d06-8bbf-719ccc7bff83 req-bd95b479-6028-4947-8b99-ab55aebf8d4c service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] No waiting events found dispatching network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:10 user nova-compute[75288]: WARNING nova.compute.manager [req-8344c9b9-4fff-4d06-8bbf-719ccc7bff83 req-bd95b479-6028-4947-8b99-ab55aebf8d4c service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received unexpected event network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e for instance with vm_state building and task_state spawning.
Dec 01 13:55:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:11 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-fb1ff752-df79-465b-aa7b-af81a6d32e2a req-943d2edd-e825-4234-8694-3fe8e204d69e service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fb1ff752-df79-465b-aa7b-af81a6d32e2a req-943d2edd-e825-4234-8694-3fe8e204d69e service nova] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fb1ff752-df79-465b-aa7b-af81a6d32e2a req-943d2edd-e825-4234-8694-3fe8e204d69e service nova] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fb1ff752-df79-465b-aa7b-af81a6d32e2a req-943d2edd-e825-4234-8694-3fe8e204d69e service nova] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-fb1ff752-df79-465b-aa7b-af81a6d32e2a req-943d2edd-e825-4234-8694-3fe8e204d69e service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] No waiting events found dispatching network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:12 user nova-compute[75288]: WARNING nova.compute.manager [req-fb1ff752-df79-465b-aa7b-af81a6d32e2a req-943d2edd-e825-4234-8694-3fe8e204d69e service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received unexpected event network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e for instance with vm_state building and task_state spawning.
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:55:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Instance spawned successfully.
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:55:12 user nova-compute[75288]: INFO nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Took 6.19 seconds to spawn the instance on the hypervisor.
Dec 01 13:55:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:12 user nova-compute[75288]: INFO nova.compute.manager [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Took 7.10 seconds to build instance.
Dec 01 13:55:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-475e9ae9-cf10-459a-8f54-a62f504a0d88 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.207s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:55:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:55:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7115MB free_disk=25.146728515625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ce476b0b-4ed7-42bc-9801-860255953006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 515aad26-e3ca-4046-84bb-d1aea072c04e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d175885c-b192-4e34-b48c-33cd3809076e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b4211312-8a32-4723-801d-47c3db348668 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:55:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:55:18 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:55:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:55:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:55:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:55:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:55:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Updating instance_info_cache with network_info: [{"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-aecbeec1-872e-48d9-beb1-cf520b587d54" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:55:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:55:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:55:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-eaf810cc-3aac-4498-9282-45f8d371f082 req-a37d5f8e-66d4-477b-b87a-dd8498d3c23e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-changed-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-eaf810cc-3aac-4498-9282-45f8d371f082 req-a37d5f8e-66d4-477b-b87a-dd8498d3c23e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Refreshing instance network info cache due to event network-changed-5917cafb-8c56-4596-a17c-e6babc227cfe. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:55:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eaf810cc-3aac-4498-9282-45f8d371f082 req-a37d5f8e-66d4-477b-b87a-dd8498d3c23e service nova] Acquiring lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eaf810cc-3aac-4498-9282-45f8d371f082 req-a37d5f8e-66d4-477b-b87a-dd8498d3c23e service nova] Acquired lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-eaf810cc-3aac-4498-9282-45f8d371f082 req-a37d5f8e-66d4-477b-b87a-dd8498d3c23e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Refreshing network info cache for port 5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:55:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-eaf810cc-3aac-4498-9282-45f8d371f082 req-a37d5f8e-66d4-477b-b87a-dd8498d3c23e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updated VIF entry in instance network info cache for port 5917cafb-8c56-4596-a17c-e6babc227cfe. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:55:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-eaf810cc-3aac-4498-9282-45f8d371f082 req-a37d5f8e-66d4-477b-b87a-dd8498d3c23e service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updating instance_info_cache with network_info: [{"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eaf810cc-3aac-4498-9282-45f8d371f082 req-a37d5f8e-66d4-477b-b87a-dd8498d3c23e service nova] Releasing lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "515aad26-e3ca-4046-84bb-d1aea072c04e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:22 user nova-compute[75288]: INFO nova.compute.manager [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Terminating instance
Dec 01 13:55:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:55:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-changed-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Refreshing instance network info cache due to event network-changed-5917cafb-8c56-4596-a17c-e6babc227cfe. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Acquiring lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Acquired lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Refreshing network info cache for port 5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Instance destroyed successfully.
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lazy-loading 'resources' on Instance uuid 515aad26-e3ca-4046-84bb-d1aea072c04e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-679148964',display_name='tempest-TestVolumeBootPattern-server-679148964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-679148964',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-cdddi0x0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:53:56Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=515aad26-e3ca-4046-84bb-d1aea072c04e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:20:43,bridge_name='br-int',has_traffic_filtering=True,id=5917cafb-8c56-4596-a17c-e6babc227cfe,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5917cafb-8c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_vif [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:20:43,bridge_name='br-int',has_traffic_filtering=True,id=5917cafb-8c56-4596-a17c-e6babc227cfe,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5917cafb-8c') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5917cafb-8c, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16c8f87d-07ed-46c8-8174-503f441a99b0) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:55:23 user nova-compute[75288]: INFO os_vif [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:20:43,bridge_name='br-int',has_traffic_filtering=True,id=5917cafb-8c56-4596-a17c-e6babc227cfe,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5917cafb-8c')
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSwmIUok', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:55:23 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[01589710-61e3-451b-8b83-4fb0df802185]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:55:23 user nova-compute[75288]: No targets found.
Dec 01 13:55:23 user nova-compute[75288]: iSNS:
Dec 01 13:55:23 user nova-compute[75288]: No targets found.
Dec 01 13:55:23 user nova-compute[75288]: STATIC:
Dec 01 13:55:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296
Dec 01 13:55:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:55:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:55:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef
Dec 01 13:55:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:55:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:55:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:55:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:55:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:55:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 13:55:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:55:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:55:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:55:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:55:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:55:23 user nova-compute[75288]: FIRMWARE:
Dec 01 13:55:23 user nova-compute[75288]: No targets found.
Dec 01 13:55:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:55:23 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:55:23 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91de9b6-b4d2-4672-9371-1981da6c648f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ddd302-add5-4518-8c71-53f012d63006]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:55:23 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:55:23 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:55:23 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:55:23 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:55:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:55:23 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:55:23 user nova-compute[75288]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 (non-flash)
Dec 01 13:55:23 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:55:23 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:55:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbe03eadd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb42cae0-ebcf-4377-993f-4cd52f2bf916]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8e5678-25cf-4e8a-9ac4-5901e5303d6e]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbe9274-4c6a-4d35-a04b-518f36cf2887]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[02597028-a5a4-466e-860a-382e82214a8e]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updated VIF entry in instance network info cache for port 5917cafb-8c56-4596-a17c-e6babc227cfe. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updating instance_info_cache with network_info: [{"id": "5917cafb-8c56-4596-a17c-e6babc227cfe", "address": "fa:16:3e:f5:20:43", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5917cafb-8c", "ovs_interfaceid": "5917cafb-8c56-4596-a17c-e6babc227cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc93a67-1c85-4b72-9288-48d531d42f93]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Releasing lock "refresh_cache-515aad26-e3ca-4046-84bb-d1aea072c04e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-vif-unplugged-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Acquiring lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] No waiting events found dispatching network-vif-unplugged-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-vif-unplugged-5917cafb-8c56-4596-a17c-e6babc227cfe for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Acquiring lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] No waiting events found dispatching network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:23 user nova-compute[75288]: WARNING nova.compute.manager [req-373a5736-0c83-4e5a-a8ec-6c9fefababd4 req-c0fd8bd0-fe45-41f4-83dd-ff4f7c9c7aa8 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received unexpected event network-vif-plugged-5917cafb-8c56-4596-a17c-e6babc227cfe for instance with vm_state active and task_state deleting.
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b955a0-0d71-44aa-857a-ba93119107e1]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296, portal: 172.16.0.220,3260]
Dec 01 13:55:23 user nova-compute[75288]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296, portal: 172.16.0.220,3260] successful.
Dec 01 13:55:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d2f7a26-cde2-4580-904a-d649483cb296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff20021-92bd-4c7a-bd1d-1580de9b98dd]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== disconnect_volume: return (387ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:55:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Deleting instance files /opt/stack/data/nova/instances/515aad26-e3ca-4046-84bb-d1aea072c04e_del
Dec 01 13:55:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Deletion of /opt/stack/data/nova/instances/515aad26-e3ca-4046-84bb-d1aea072c04e_del complete
Dec 01 13:55:24 user nova-compute[75288]: INFO nova.compute.manager [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Took 1.35 seconds to destroy the instance on the hypervisor.
Dec 01 13:55:24 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:55:24 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:24 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Took 0.57 seconds to deallocate network for instance.
Dec 01 13:55:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-e2f3a556-dd18-4f38-b298-ece249923f42 req-3daa0233-34b0-4522-882e-bb0c9c857595 service nova] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Received event network-vif-deleted-5917cafb-8c56-4596-a17c-e6babc227cfe {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:25 user nova-compute[75288]: INFO nova.compute.manager [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 515aad26-e3ca-4046-84bb-d1aea072c04e] Took 0.88 seconds to detach 1 volumes for instance.
Dec 01 13:55:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:25 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:55:25 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:55:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:26 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Deleted allocations for instance 515aad26-e3ca-4046-84bb-d1aea072c04e
Dec 01 13:55:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e3243972-4d95-4dc1-8dcf-9ee1ef202e1a tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "515aad26-e3ca-4046-84bb-d1aea072c04e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.395s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-6fd1cb16-4cbb-456a-90eb-077187a7db0d req-e34c86e6-cf84-49dd-84a9-907b617c0309 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-changed-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-6fd1cb16-4cbb-456a-90eb-077187a7db0d req-e34c86e6-cf84-49dd-84a9-907b617c0309 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Refreshing instance network info cache due to event network-changed-a4d06e3a-671b-493e-b9b8-4400f24f7877. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:55:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6fd1cb16-4cbb-456a-90eb-077187a7db0d req-e34c86e6-cf84-49dd-84a9-907b617c0309 service nova] Acquiring lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6fd1cb16-4cbb-456a-90eb-077187a7db0d req-e34c86e6-cf84-49dd-84a9-907b617c0309 service nova] Acquired lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-6fd1cb16-4cbb-456a-90eb-077187a7db0d req-e34c86e6-cf84-49dd-84a9-907b617c0309 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Refreshing network info cache for port a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:55:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-6fd1cb16-4cbb-456a-90eb-077187a7db0d req-e34c86e6-cf84-49dd-84a9-907b617c0309 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updated VIF entry in instance network info cache for port a4d06e3a-671b-493e-b9b8-4400f24f7877. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:55:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-6fd1cb16-4cbb-456a-90eb-077187a7db0d req-e34c86e6-cf84-49dd-84a9-907b617c0309 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6fd1cb16-4cbb-456a-90eb-077187a7db0d req-e34c86e6-cf84-49dd-84a9-907b617c0309 service nova] Releasing lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:32 user nova-compute[75288]: INFO nova.compute.manager [None req-fe3a2e08-353a-4040-b4ab-5afec4473348 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Unrescuing
Dec 01 13:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe3a2e08-353a-4040-b4ab-5afec4473348 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe3a2e08-353a-4040-b4ab-5afec4473348 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquired lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fe3a2e08-353a-4040-b4ab-5afec4473348 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fe3a2e08-353a-4040-b4ab-5afec4473348 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updating instance_info_cache with network_info: [{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fe3a2e08-353a-4040-b4ab-5afec4473348 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Releasing lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fe3a2e08-353a-4040-b4ab-5afec4473348 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'flavor' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:32 user nova-compute[75288]: INFO nova.compute.manager [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Shelving
Dec 01 13:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-48559819-177f-4c7c-96f2-2ac19580ccd6 req-70ba013a-b4fc-458a-86d6-f0241bd20937 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-48559819-177f-4c7c-96f2-2ac19580ccd6 req-70ba013a-b4fc-458a-86d6-f0241bd20937 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-48559819-177f-4c7c-96f2-2ac19580ccd6 req-70ba013a-b4fc-458a-86d6-f0241bd20937 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-48559819-177f-4c7c-96f2-2ac19580ccd6 req-70ba013a-b4fc-458a-86d6-f0241bd20937 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-48559819-177f-4c7c-96f2-2ac19580ccd6 req-70ba013a-b4fc-458a-86d6-f0241bd20937 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:33 user nova-compute[75288]: WARNING nova.compute.manager [req-48559819-177f-4c7c-96f2-2ac19580ccd6 req-70ba013a-b4fc-458a-86d6-f0241bd20937 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance destroyed successfully.
Dec 01 13:55:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance destroyed successfully.
Dec 01 13:55:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Beginning cold snapshot process
Dec 01 13:55:34 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk /opt/stack/data/nova/instances/snapshots/tmpfdztbewt/67296e6148fc4a0688920350161b5eee {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk /opt/stack/data/nova/instances/snapshots/tmpfdztbewt/67296e6148fc4a0688920350161b5eee" returned: 0 in 0.892s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Snapshot extracted, beginning image upload
Dec 01 13:55:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:35 user nova-compute[75288]: WARNING nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:55:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-unplugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] No waiting events found dispatching network-vif-unplugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:35 user nova-compute[75288]: WARNING nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received unexpected event network-vif-unplugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 for instance with vm_state active and task_state shelving_image_uploading.
Dec 01 13:55:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] No waiting events found dispatching network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:35 user nova-compute[75288]: WARNING nova.compute.manager [req-6f152167-06c5-4817-8017-6ca61e0c8b92 req-6e098201-199d-4b23-8bb3-c401ea27777c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received unexpected event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 for instance with vm_state active and task_state shelving_image_uploading.
Dec 01 13:55:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-ff3dd7f5-9166-4119-acfd-81f593257674 req-dabd529b-8e9e-4e47-b9f0-16506ee0bdf2 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received event network-changed-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG nova.compute.manager [req-ff3dd7f5-9166-4119-acfd-81f593257674 req-dabd529b-8e9e-4e47-b9f0-16506ee0bdf2 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Refreshing instance network info cache due to event network-changed-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff3dd7f5-9166-4119-acfd-81f593257674 req-dabd529b-8e9e-4e47-b9f0-16506ee0bdf2 service nova] Acquiring lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff3dd7f5-9166-4119-acfd-81f593257674 req-dabd529b-8e9e-4e47-b9f0-16506ee0bdf2 service nova] Acquired lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-ff3dd7f5-9166-4119-acfd-81f593257674 req-dabd529b-8e9e-4e47-b9f0-16506ee0bdf2 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Refreshing network info cache for port ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'flavor' on Instance uuid cb82677d-4aba-488b-a8f5-33ceada2c0e2 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:55:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Ignoring supplied device name: /dev/vdb
Dec 01 13:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:37 user nova-compute[75288]: INFO nova.compute.manager [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Attaching volume 9df95112-31af-4643-be97-6d7e1a1ed065 to /dev/vdb
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-ff3dd7f5-9166-4119-acfd-81f593257674 req-dabd529b-8e9e-4e47-b9f0-16506ee0bdf2 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Updated VIF entry in instance network info cache for port ad84b096-90e0-41f9-9baa-2bb79f9a9fb4. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.network.neutron [req-ff3dd7f5-9166-4119-acfd-81f593257674 req-dabd529b-8e9e-4e47-b9f0-16506ee0bdf2 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Updating instance_info_cache with network_info: [{"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ff3dd7f5-9166-4119-acfd-81f593257674 req-dabd529b-8e9e-4e47-b9f0-16506ee0bdf2 service nova] Releasing lock "refresh_cache-cb82677d-4aba-488b-a8f5-33ceada2c0e2" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[884329c4-1f09-45f3-8d94-c2cbc326da85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eebbfa-b99f-4d84-9352-807b9ee873fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1f925f-6928-42be-9d49-9842a9780dbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ddc202-3803-493a-bf9d-33e2e0ab3cda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fe3a2e08-353a-4040-b4ab-5afec4473348 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:55:37 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6076a3-517c-4313-b7f8-9e9b566caef5]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG os_brick.utils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Updating existing volume attachment record: cda3ebfe-ea97-4486-83f9-c96103c161e4 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:37 user nova-compute[75288]: WARNING nova.compute.manager [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:37 user nova-compute[75288]: WARNING nova.compute.manager [req-523e6692-9ea2-4592-b9d9-2c2d676b5181 req-dc31e367-98b9-478b-a04a-9ae0a430c5f5 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:55:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Snapshot image upload complete
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:55:37 user nova-compute[75288]: INFO nova.compute.manager [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Shelve offloading
Dec 01 13:55:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance destroyed successfully.
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquired lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Releasing lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance destroyed successfully.
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'resources' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839517980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839517980',id=30,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQjRBfwBrWv++1UyxHenT16L3KFq6cSakLqlfmoGCl+bZVIfzlkHjCfl3H+BqULca2NxH+oj7D7R0RHzmyXm6b4Z/EU4SiGeF/xATyhIZFOE6n8jfxD/M/LqDc9wbO0Dw==',key_name='tempest-keypair-1302462361',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-1nhecb1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member',shelved_at='2023-12-01T13:55:37.586984',shelved_host='user',shelved_image_id='c0828d29-3cf1-4e35-8214-592a362ee007'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=d175885c-b192-4e34-b48c-33cd3809076e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG os_vif [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4d06e3a-67, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=052b80db-2ba3-4906-88fb-529b4fe95e7a) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-f90a3295-d7f6-49d4-9834-b21d5b8a3cec req-069034a0-a21a-4ff5-bf8c-95dbc85707ba service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-changed-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-f90a3295-d7f6-49d4-9834-b21d5b8a3cec req-069034a0-a21a-4ff5-bf8c-95dbc85707ba service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Refreshing instance network info cache due to event network-changed-a4d06e3a-671b-493e-b9b8-4400f24f7877. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f90a3295-d7f6-49d4-9834-b21d5b8a3cec req-069034a0-a21a-4ff5-bf8c-95dbc85707ba service nova] Acquiring lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f90a3295-d7f6-49d4-9834-b21d5b8a3cec req-069034a0-a21a-4ff5-bf8c-95dbc85707ba service nova] Acquired lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-f90a3295-d7f6-49d4-9834-b21d5b8a3cec req-069034a0-a21a-4ff5-bf8c-95dbc85707ba service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Refreshing network info cache for port a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:55:38 user nova-compute[75288]: INFO os_vif [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67')
Dec 01 13:55:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Deleting instance files /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e_del
Dec 01 13:55:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Deletion of /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e_del complete
Dec 01 13:55:38 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Deleted allocations for instance d175885c-b192-4e34-b48c-33cd3809076e
Dec 01 13:55:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'numa_topology' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:55:38 user nova-compute[75288]: DEBUG nova.objects.base [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<d175885c-b192-4e34-b48c-33cd3809076e> lazy-loaded attributes: resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:55:39 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:55:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:55:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-50cd799e-5266-42d9-8e0e-ae5e428c0f43 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.364s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-f90a3295-d7f6-49d4-9834-b21d5b8a3cec req-069034a0-a21a-4ff5-bf8c-95dbc85707ba service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updated VIF entry in instance network info cache for port a4d06e3a-671b-493e-b9b8-4400f24f7877. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:55:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-f90a3295-d7f6-49d4-9834-b21d5b8a3cec req-069034a0-a21a-4ff5-bf8c-95dbc85707ba service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f90a3295-d7f6-49d4-9834-b21d5b8a3cec req-069034a0-a21a-4ff5-bf8c-95dbc85707ba service nova] Releasing lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlpteWAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:55:46 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:55:46 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:55:46 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bc5090-6422-409f-aabc-c834c9e6794c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:55:46 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3aa931-25d2-476d-8c58-873984b9919f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065] added
Dec 01 13:55:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.108s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[084f9453-e376-4344-a45d-629ead7b0594]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bb6d7f-1623-4647-93d2-317d523a4445]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlpteWAT {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BlpteWAT" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a7b82-3ed6-4a3e-8e08-5b17fde2aa13]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BlpteWAT'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[643fa49d-4ed3-422b-9732-e15442c547ff]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e241b5-90b5-4363-9d4c-4fa1afd6bdbe]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --login" returned: 0 in 0.155s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c8ab2-be68-47a1-81e4-dcb9cec23d82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065, portal: 172.16.0.220,3260]
Dec 01 13:55:46 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065, portal: 172.16.0.220,3260] successful.
Dec 01 13:55:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[105da44a-c492-461f-a825-1c9f91cfb5a5]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d30dbc-2514-43e7-891a-074806d5de79]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)
Dec 01 13:55:46 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[968c231b-b490-4a4e-9522-d443d4e5008e]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:55:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlpteWAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:55:47 user nova-compute[75288]: INFO nova.compute.manager [None req-893cbae8-3e95-4385-9dcd-dbfa8e1b7b28 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Unrescuing
Dec 01 13:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-893cbae8-3e95-4385-9dcd-dbfa8e1b7b28 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-893cbae8-3e95-4385-9dcd-dbfa8e1b7b28 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquired lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-893cbae8-3e95-4385-9dcd-dbfa8e1b7b28 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-893cbae8-3e95-4385-9dcd-dbfa8e1b7b28 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating instance_info_cache with network_info: [{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-893cbae8-3e95-4385-9dcd-dbfa8e1b7b28 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Releasing lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-893cbae8-3e95-4385-9dcd-dbfa8e1b7b28 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'flavor' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.525s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] <== connect_volume: return (1528ms) {'type': 'block', 'scsi_wwn': '23733613666356130', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733613666356130', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-fedd5edc-9e05-49fe-8563-a9c84e7bc61f req-74db99a0-a2b2-4b24-ab42-f7edcd22491e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fedd5edc-9e05-49fe-8563-a9c84e7bc61f req-74db99a0-a2b2-4b24-ab42-f7edcd22491e service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fedd5edc-9e05-49fe-8563-a9c84e7bc61f req-74db99a0-a2b2-4b24-ab42-f7edcd22491e service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fedd5edc-9e05-49fe-8563-a9c84e7bc61f req-74db99a0-a2b2-4b24-ab42-f7edcd22491e service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-fedd5edc-9e05-49fe-8563-a9c84e7bc61f req-74db99a0-a2b2-4b24-ab42-f7edcd22491e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:47 user nova-compute[75288]: WARNING nova.compute.manager [req-fedd5edc-9e05-49fe-8563-a9c84e7bc61f req-74db99a0-a2b2-4b24-ab42-f7edcd22491e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:55:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'flavor' on Instance uuid cb82677d-4aba-488b-a8f5-33ceada2c0e2 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:55:47 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:55:47 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:55:47 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:55:47 user nova-compute[75288]:   <serial>9df95112-31af-4643-be97-6d7e1a1ed065</serial>
Dec 01 13:55:47 user nova-compute[75288]: </disk>
Dec 01 13:55:47 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:55:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:55:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No VIF found with MAC fa:16:3e:4a:70:0f, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:55:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b195bbb8-34cb-40df-8d7e-4b020babe018 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.715s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance destroyed successfully.
Dec 01 13:55:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-6fbf09f4-b70b-4f88-89f4-692ab570fbb0 req-4de75c46-67f2-4285-9e88-cc275b86f413 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6fbf09f4-b70b-4f88-89f4-692ab570fbb0 req-4de75c46-67f2-4285-9e88-cc275b86f413 service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6fbf09f4-b70b-4f88-89f4-692ab570fbb0 req-4de75c46-67f2-4285-9e88-cc275b86f413 service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6fbf09f4-b70b-4f88-89f4-692ab570fbb0 req-4de75c46-67f2-4285-9e88-cc275b86f413 service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-6fbf09f4-b70b-4f88-89f4-692ab570fbb0 req-4de75c46-67f2-4285-9e88-cc275b86f413 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:49 user nova-compute[75288]: WARNING nova.compute.manager [req-6fbf09f4-b70b-4f88-89f4-692ab570fbb0 req-4de75c46-67f2-4285-9e88-cc275b86f413 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:55:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:51 user nova-compute[75288]: WARNING nova.compute.manager [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:55:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:55:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:55:51 user nova-compute[75288]: WARNING nova.compute.manager [req-12e33726-67cd-49f8-8667-c97c75a0fbbf req-c55a3f91-5b16-491a-8eae-da0f29a5428a service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 13:55:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-893cbae8-3e95-4385-9dcd-dbfa8e1b7b28 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:55:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:55:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:10 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:56:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:14 user nova-compute[75288]: INFO nova.compute.manager [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Detaching volume 9df95112-31af-4643-be97-6d7e1a1ed065
Dec 01 13:56:14 user nova-compute[75288]: INFO nova.virt.block_device [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Attempting to driver detach volume 9df95112-31af-4643-be97-6d7e1a1ed065 from mountpoint /dev/vdb
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Attempting to detach device vdb from instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:56:14 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:56:14 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:56:14 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:56:14 user nova-compute[75288]:   <serial>9df95112-31af-4643-be97-6d7e1a1ed065</serial>
Dec 01 13:56:14 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:56:14 user nova-compute[75288]: </disk>
Dec 01 13:56:14 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:56:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Successfully detached device vdb from instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 from the persistent domain config.
Dec 01 13:56:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:56:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:56:14 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:56:14 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:56:14 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:56:14 user nova-compute[75288]:   <serial>9df95112-31af-4643-be97-6d7e1a1ed065</serial>
Dec 01 13:56:14 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:56:14 user nova-compute[75288]: </disk>
Dec 01 13:56:14 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:56:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:56:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7580MB free_disk=25.09563446044922GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ce476b0b-4ed7-42bc-9801-860255953006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b4211312-8a32-4723-801d-47c3db348668 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:56:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:56:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:56:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:56:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:56:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:56:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 13:56:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:56:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:56:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-6982039f-bfaf-4da5-a31b-20d4f4023d38 req-00334b4f-005f-4d59-81e9-d8a0f734b6bc service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-changed-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-6982039f-bfaf-4da5-a31b-20d4f4023d38 req-00334b4f-005f-4d59-81e9-d8a0f734b6bc service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Refreshing instance network info cache due to event network-changed-f892e403-d0f3-4631-859d-6e101c9b33de. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6982039f-bfaf-4da5-a31b-20d4f4023d38 req-00334b4f-005f-4d59-81e9-d8a0f734b6bc service nova] Acquiring lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6982039f-bfaf-4da5-a31b-20d4f4023d38 req-00334b4f-005f-4d59-81e9-d8a0f734b6bc service nova] Acquired lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-6982039f-bfaf-4da5-a31b-20d4f4023d38 req-00334b4f-005f-4d59-81e9-d8a0f734b6bc service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Refreshing network info cache for port f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:22 user nova-compute[75288]: INFO nova.compute.manager [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Terminating instance
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-75a2203b-122a-45d8-8a05-b1d0120c4d13 req-ed8c567a-bbcd-49e4-9e8c-c136b45419f1 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-vif-unplugged-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-75a2203b-122a-45d8-8a05-b1d0120c4d13 req-ed8c567a-bbcd-49e4-9e8c-c136b45419f1 service nova] Acquiring lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-75a2203b-122a-45d8-8a05-b1d0120c4d13 req-ed8c567a-bbcd-49e4-9e8c-c136b45419f1 service nova] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-75a2203b-122a-45d8-8a05-b1d0120c4d13 req-ed8c567a-bbcd-49e4-9e8c-c136b45419f1 service nova] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-75a2203b-122a-45d8-8a05-b1d0120c4d13 req-ed8c567a-bbcd-49e4-9e8c-c136b45419f1 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] No waiting events found dispatching network-vif-unplugged-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-75a2203b-122a-45d8-8a05-b1d0120c4d13 req-ed8c567a-bbcd-49e4-9e8c-c136b45419f1 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-vif-unplugged-f892e403-d0f3-4631-859d-6e101c9b33de for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-6982039f-bfaf-4da5-a31b-20d4f4023d38 req-00334b4f-005f-4d59-81e9-d8a0f734b6bc service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updated VIF entry in instance network info cache for port f892e403-d0f3-4631-859d-6e101c9b33de. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-6982039f-bfaf-4da5-a31b-20d4f4023d38 req-00334b4f-005f-4d59-81e9-d8a0f734b6bc service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updating instance_info_cache with network_info: [{"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:56:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6982039f-bfaf-4da5-a31b-20d4f4023d38 req-00334b4f-005f-4d59-81e9-d8a0f734b6bc service nova] Releasing lock "refresh_cache-5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:56:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Instance destroyed successfully.
Dec 01 13:56:23 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lazy-loading 'resources' on Instance uuid 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1442028936',display_name='tempest-TestVolumeBootPattern-server-1442028936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1442028936',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QcXJGqeB8SN+xokbjDGpnip6Ga+jNh7eOUi/XIsugXPKe0F8IPzAfJ7obl5hbNBYbdtfKTKEXZeP+pr/fPNZAMjvQbCp+jnQ2VQlWpGxqLZPIQTxUNX+lRt3FHILOug==',key_name='tempest-TestVolumeBootPattern-1093545701',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:51:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1120cc4cc3d8458aaf5755a500e994c6',ramdisk_id='',reservation_id='r-jjon80zu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-367476607',owner_user_name='tempest-TestVolumeBootPattern-367476607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:51:43Z,user_data=None,user_id='ab6a9e09550e42edac3c1e8a9112fbd1',uuid=5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converting VIF {"id": "f892e403-d0f3-4631-859d-6e101c9b33de", "address": "fa:16:3e:12:42:d2", "network": {"id": "2d9debab-9108-4b62-a730-4418da65072d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1473981531-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1120cc4cc3d8458aaf5755a500e994c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf892e403-d0", "ovs_interfaceid": "f892e403-d0f3-4631-859d-6e101c9b33de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=f892e403-d0f3-4631-859d-6e101c9b33de,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf892e403-d0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_vif [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=f892e403-d0f3-4631-859d-6e101c9b33de,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf892e403-d0') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf892e403-d0, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdde2589-1650-49d2-ad89-16310ebe331b) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:56:23 user nova-compute[75288]: INFO os_vif [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:42:d2,bridge_name='br-int',has_traffic_filtering=True,id=f892e403-d0f3-4631-859d-6e101c9b33de,network=Network(2d9debab-9108-4b62-a730-4418da65072d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf892e403-d0')
Dec 01 13:56:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KraZUmid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:56:23 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[457784e4-dc78-49eb-9e8a-d93406d2820c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:56:23 user nova-compute[75288]: No targets found.
Dec 01 13:56:23 user nova-compute[75288]: iSNS:
Dec 01 13:56:23 user nova-compute[75288]: No targets found.
Dec 01 13:56:23 user nova-compute[75288]: STATIC:
Dec 01 13:56:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef
Dec 01 13:56:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:56:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 13:56:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065
Dec 01 13:56:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4
Dec 01 13:56:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:23 user nova-compute[75288]: FIRMWARE:
Dec 01 13:56:23 user nova-compute[75288]: No targets found.
Dec 01 13:56:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:56:23 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:56:23 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a054679e-0636-46f3-a688-6ea36d30ac7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56af6ad-54a9-45a4-87b9-5d6bea62bf71]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:56:23 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:23 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:23 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:23 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)
Dec 01 13:56:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 (non-flash)
Dec 01 13:56:23 user nova-compute[75288]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:23 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:23 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:23 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)
Dec 01 13:56:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc27ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5bc8eb-6442-49f8-952a-9663caedfdeb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[613850f9-b579-4aab-8a13-2edbb1c09f33]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b8774d-7e5c-4356-a84d-f2065154ebed]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[261a9928-0e4d-4d0e-b897-016e70328d9c]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc307014-9c81-4ea0-99d5-53e7b1b164ac]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3508cd-a9c8-4e35-8f74-0e20c5502a18]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260]
Dec 01 13:56:23 user nova-compute[75288]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4, portal: 172.16.0.220,3260] successful.
Dec 01 13:56:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb587a52-3fa5-460e-bb89-6e50e873f6e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda55c5-6d0c-4e9c-8ac6-972930050e20]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] <== disconnect_volume: return (329ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:56:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Deleting instance files /opt/stack/data/nova/instances/5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f_del
Dec 01 13:56:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Deletion of /opt/stack/data/nova/instances/5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f_del complete
Dec 01 13:56:23 user nova-compute[75288]: INFO nova.compute.manager [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 01 13:56:23 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:56:23 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:56:24 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:56:24 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Took 0.49 seconds to deallocate network for instance.
Dec 01 13:56:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-28d9c599-6779-4e67-b029-fa5cfd9cf600 req-4f35756c-357b-49d9-b96b-6565755ee5a7 service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-vif-deleted-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-0596dcbc-21bf-465c-bac8-f5599d9918ae req-405fcd70-6502-4b29-bffe-9bf86327128d service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received event network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0596dcbc-21bf-465c-bac8-f5599d9918ae req-405fcd70-6502-4b29-bffe-9bf86327128d service nova] Acquiring lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0596dcbc-21bf-465c-bac8-f5599d9918ae req-405fcd70-6502-4b29-bffe-9bf86327128d service nova] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0596dcbc-21bf-465c-bac8-f5599d9918ae req-405fcd70-6502-4b29-bffe-9bf86327128d service nova] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-0596dcbc-21bf-465c-bac8-f5599d9918ae req-405fcd70-6502-4b29-bffe-9bf86327128d service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] No waiting events found dispatching network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:56:24 user nova-compute[75288]: WARNING nova.compute.manager [req-0596dcbc-21bf-465c-bac8-f5599d9918ae req-405fcd70-6502-4b29-bffe-9bf86327128d service nova] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Received unexpected event network-vif-plugged-f892e403-d0f3-4631-859d-6e101c9b33de for instance with vm_state active and task_state deleting.
Dec 01 13:56:24 user nova-compute[75288]: INFO nova.compute.manager [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] [instance: 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f] Took 0.78 seconds to detach 1 volumes for instance.
Dec 01 13:56:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:25 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:56:25 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:56:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:25 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Deleted allocations for instance 5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f
Dec 01 13:56:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3bd99947-b92c-4d23-b010-de360a758ff3 tempest-TestVolumeBootPattern-367476607 tempest-TestVolumeBootPattern-367476607-project-member] Lock "5fd21cf9-9be8-47a7-83b7-05acf3fe8f8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.199s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 is timed out.
Dec 01 13:56:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Successfully detached device vdb from instance cb82677d-4aba-488b-a8f5-33ceada2c0e2 from the live domain config.
Dec 01 13:56:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlpteWAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:56:35 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea68ebf-3ffa-4bfb-90f3-9928b876a04b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:56:35 user nova-compute[75288]: No targets found.
Dec 01 13:56:35 user nova-compute[75288]: iSNS:
Dec 01 13:56:35 user nova-compute[75288]: No targets found.
Dec 01 13:56:35 user nova-compute[75288]: STATIC:
Dec 01 13:56:35 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef
Dec 01 13:56:35 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:35 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:35 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:56:35 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:35 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:35 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 13:56:35 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:35 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:35 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065
Dec 01 13:56:35 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:35 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:35 user nova-compute[75288]: FIRMWARE:
Dec 01 13:56:35 user nova-compute[75288]: No targets found.
Dec 01 13:56:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:56:35 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:56:35 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cc2f57-710f-4a18-9970-e85216a013e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fce06e3-313c-4f0c-b863-063ef5f9ccd1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:35 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:35 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:35 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)
Dec 01 13:56:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:35 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:35 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:35 user nova-compute[75288]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 (non-flash)
Dec 01 13:56:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98dca3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db10dfb-18a0-48b6-b9cf-cd0135355dc4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[877f8154-d022-4fdf-8c38-97acf22b2273]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[37105452-125d-422d-b9a7-93d67a9bd6bc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[095c2d11-f938-46e8-87b9-84d31ae09153]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d622ac0-9603-4d85-952f-637341efa848]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b3ec57-eefa-4c9e-89c6-e214ad1b9d7b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065, portal: 172.16.0.220,3260]
Dec 01 13:56:35 user nova-compute[75288]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065, portal: 172.16.0.220,3260] successful.
Dec 01 13:56:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3d7dbe-6873-4477-bc2b-d808ff5e7dec]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] <== disconnect_volume: return (310ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:56:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'flavor' on Instance uuid cb82677d-4aba-488b-a8f5-33ceada2c0e2 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-df740bd5-1f3d-432d-bfdc-cdb78e65f713 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.860s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.748s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:36 user nova-compute[75288]: INFO nova.compute.manager [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Terminating instance
Dec 01 13:56:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-d9c0ddc3-fff7-4fd0-b333-c0fe73b35d7e req-e136f558-6000-4c76-8244-5ce815332d4b service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received event network-vif-unplugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9c0ddc3-fff7-4fd0-b333-c0fe73b35d7e req-e136f558-6000-4c76-8244-5ce815332d4b service nova] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9c0ddc3-fff7-4fd0-b333-c0fe73b35d7e req-e136f558-6000-4c76-8244-5ce815332d4b service nova] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d9c0ddc3-fff7-4fd0-b333-c0fe73b35d7e req-e136f558-6000-4c76-8244-5ce815332d4b service nova] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-d9c0ddc3-fff7-4fd0-b333-c0fe73b35d7e req-e136f558-6000-4c76-8244-5ce815332d4b service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] No waiting events found dispatching network-vif-unplugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-d9c0ddc3-fff7-4fd0-b333-c0fe73b35d7e req-e136f558-6000-4c76-8244-5ce815332d4b service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received event network-vif-unplugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Instance destroyed successfully.
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'resources' on Instance uuid cb82677d-4aba-488b-a8f5-33ceada2c0e2 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:53:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-541179737',display_name='tempest-VolumesSnapshotTestJSON-instance-541179737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-541179737',id=31,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPailbcxoITl4OEXs8gL6zRh9m8xNOMgQb/p7bKDNL0hKtKPqWIXCX9oWfRxdrmqFphMZCj018JU4o9RgbehQ2RON+eFsZMyfcMXPzr/lyfrGE/sOyZz2w18XKy2hJtw7g==',key_name='tempest-keypair-679868516',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab33b0750b8b4f199df0d6dfe6136a8b',ramdisk_id='',reservation_id='r-n15e4nw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-383967549',owner_user_name='tempest-VolumesSnapshotTestJSON-383967549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e384ef4f5a36497d8e805cf7cc87f32e',uuid=cb82677d-4aba-488b-a8f5-33ceada2c0e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converting VIF {"id": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "address": "fa:16:3e:4a:70:0f", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad84b096-90", "ovs_interfaceid": "ad84b096-90e0-41f9-9baa-2bb79f9a9fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=ad84b096-90e0-41f9-9baa-2bb79f9a9fb4,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad84b096-90') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_vif [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=ad84b096-90e0-41f9-9baa-2bb79f9a9fb4,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad84b096-90') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad84b096-90, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88fa54d1-5b40-4e00-9729-93e5f50b992d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:37 user nova-compute[75288]: INFO os_vif [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:70:0f,bridge_name='br-int',has_traffic_filtering=True,id=ad84b096-90e0-41f9-9baa-2bb79f9a9fb4,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad84b096-90')
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BlpteWAT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:56:37 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55dfc83-68e2-4a48-a6e0-7304cba236f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:56:37 user nova-compute[75288]: No targets found.
Dec 01 13:56:37 user nova-compute[75288]: iSNS:
Dec 01 13:56:37 user nova-compute[75288]: No targets found.
Dec 01 13:56:37 user nova-compute[75288]: STATIC:
Dec 01 13:56:37 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef
Dec 01 13:56:37 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:37 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:37 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:56:37 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:37 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:37 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 13:56:37 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:37 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:37 user nova-compute[75288]: FIRMWARE:
Dec 01 13:56:37 user nova-compute[75288]: No targets found.
Dec 01 13:56:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:56:37 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:56:37 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df95112-31af-4643-be97-6d7e1a1ed065', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8179d9f-73cc-4865-aa2e-1642220471a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d59c42-38aa-4fd9-854e-3ae627ffeb28]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:37 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:37 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:37 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:37 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:37 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc5a96c0>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] <== disconnect_volume: return (78ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:56:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Deleting instance files /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2_del
Dec 01 13:56:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Deletion of /opt/stack/data/nova/instances/cb82677d-4aba-488b-a8f5-33ceada2c0e2_del complete
Dec 01 13:56:37 user nova-compute[75288]: INFO nova.compute.manager [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Took 0.95 seconds to destroy the instance on the hypervisor.
Dec 01 13:56:37 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:56:37 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:56:38 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:56:38 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Took 0.82 seconds to deallocate network for instance.
Dec 01 13:56:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-519b1933-74f5-4640-aeb7-d011d308519d req-3722d4db-9349-438f-9db7-f4a1d87741a5 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received event network-vif-deleted-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:38 user nova-compute[75288]: WARNING nova.volume.cinder [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Attachment cda3ebfe-ea97-4486-83f9-c96103c161e4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cda3ebfe-ea97-4486-83f9-c96103c161e4. (HTTP 404) (Request-ID: req-ad921743-2f0c-4c37-8ac2-9d244921146c)
Dec 01 13:56:38 user nova-compute[75288]: INFO nova.compute.manager [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Took 0.03 seconds to detach 1 volumes for instance.
Dec 01 13:56:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:56:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:56:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:38 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Deleted allocations for instance cb82677d-4aba-488b-a8f5-33ceada2c0e2
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Stashing vm_state: active {{(pid=75288) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b72dc409-6b23-447f-82c1-f880332f63d6 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:56:39 user nova-compute[75288]: INFO nova.compute.claims [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Claim successful on node user
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received event network-changed-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Refreshing instance network info cache due to event network-changed-e66de3d0-2331-4afa-8613-0cc8bc289deb. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Acquiring lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Acquired lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Refreshing network info cache for port e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:56:39 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating resource usage from migration 8c968267-54c3-4c6a-9015-6876a33f7b69
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.410s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:39 user nova-compute[75288]: INFO nova.compute.manager [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Migrating
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquired lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updated VIF entry in instance network info cache for port e66de3d0-2331-4afa-8613-0cc8bc289deb. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Releasing lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-changed-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Refreshing instance network info cache due to event network-changed-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Acquiring lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating instance_info_cache with network_info: [{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Releasing lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Acquired lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:56:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Refreshing network info cache for port 830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Starting migrate_disk_and_power_off {{(pid=75288) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Updated VIF entry in instance network info cache for port 830b3d65-26cd-4266-a4a7-67dd9cf6dd5b. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating instance_info_cache with network_info: [{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Releasing lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received event network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Acquiring lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] Lock "cb82677d-4aba-488b-a8f5-33ceada2c0e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] No waiting events found dispatching network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:56:40 user nova-compute[75288]: WARNING nova.compute.manager [req-10fbe318-cf18-4e5d-ad49-d9e215ea2094 req-dcc096bd-a15d-4528-897d-ca52046ca985 service nova] [instance: cb82677d-4aba-488b-a8f5-33ceada2c0e2] Received unexpected event network-vif-plugged-ad84b096-90e0-41f9-9baa-2bb79f9a9fb4 for instance with vm_state deleted and task_state None.
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-edf1e4f0-45c4-49e1-8d09-34dd766201f2 req-04876686-15bb-4502-ab99-ff75dcb86268 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-unplugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-edf1e4f0-45c4-49e1-8d09-34dd766201f2 req-04876686-15bb-4502-ab99-ff75dcb86268 service nova] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-edf1e4f0-45c4-49e1-8d09-34dd766201f2 req-04876686-15bb-4502-ab99-ff75dcb86268 service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-edf1e4f0-45c4-49e1-8d09-34dd766201f2 req-04876686-15bb-4502-ab99-ff75dcb86268 service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-edf1e4f0-45c4-49e1-8d09-34dd766201f2 req-04876686-15bb-4502-ab99-ff75dcb86268 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] No waiting events found dispatching network-vif-unplugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:56:40 user nova-compute[75288]: WARNING nova.compute.manager [req-edf1e4f0-45c4-49e1-8d09-34dd766201f2 req-04876686-15bb-4502-ab99-ff75dcb86268 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received unexpected event network-vif-unplugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b for instance with vm_state active and task_state resize_migrating.
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance destroyed successfully.
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1258491341',display_name='tempest-ServerActionsTestOtherA-server-1258491341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1258491341',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:55:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-75q0eqf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=b4211312-8a32-4723-801d-47c3db348668,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1934493457-network", "vif_mac": "fa:16:3e:35:47:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1934493457-network", "vif_mac": "fa:16:3e:35:47:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG os_vif [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap830b3d65-26, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e01fcd19-3b2a-41d6-a90a-ee1959c91417) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:40 user nova-compute[75288]: INFO os_vif [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26')
Dec 01 13:56:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjbTQnir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:56:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:56:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2e2920-5a04-4eba-a4a1-9fd5f839d38f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:56:40 user nova-compute[75288]: No targets found.
Dec 01 13:56:40 user nova-compute[75288]: iSNS:
Dec 01 13:56:40 user nova-compute[75288]: No targets found.
Dec 01 13:56:40 user nova-compute[75288]: STATIC:
Dec 01 13:56:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef
Dec 01 13:56:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:40 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:56:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:40 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:40 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 13:56:40 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:56:40 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:56:40 user nova-compute[75288]: FIRMWARE:
Dec 01 13:56:40 user nova-compute[75288]: No targets found.
Dec 01 13:56:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:56:40 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:56:40 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53075f2-e225-4506-8b49-faee7d0ca0c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8301b10d-604a-4ad0-b77b-7ee293837bf9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:41 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:41 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:41 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:41 user nova-compute[75288]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ea96c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260'): ({'sdf'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Removing single pathed devices sdf {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae024302-cc02-4eb9-a39f-b3d3af68d008]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad4924-9948-45ee-b868-5bbb65dbec77]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flushing IO for device /dev/sdf {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af99ed8-5f7d-46c0-824b-f63ba54e1ebb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1245d58-8a2b-4c69-b6fc-925edf33cbc6]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO42aad0b8-603aa2273b710a7b', '/dev/disk/by-id/scsi-23630336161323237', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_42aad0b8') {{(pid=86480) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[452f6942-fe6e-4689-a542-bf9d15f7df77]: (4, None) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1109a9-1f06-4d22-b824-ac47d30941d1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe79db0-6a90-46a9-8c8e-d90933983add]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260]
Dec 01 13:56:41 user nova-compute[75288]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260] successful.
Dec 01 13:56:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0398982c-3575-4e47-bb8b-810b0a75854a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== disconnect_volume: return (349ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:56:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Port 830b3d65-26cd-4266-a4a7-67dd9cf6dd5b binding to destination host user is already ACTIVE {{(pid=75288) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-af3a07d2-277e-4367-af99-8384ff6cf4fc req-0c1e23ae-3fdc-47a7-9ca0-d4ccb4ffb1ca service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af3a07d2-277e-4367-af99-8384ff6cf4fc req-0c1e23ae-3fdc-47a7-9ca0-d4ccb4ffb1ca service nova] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af3a07d2-277e-4367-af99-8384ff6cf4fc req-0c1e23ae-3fdc-47a7-9ca0-d4ccb4ffb1ca service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-af3a07d2-277e-4367-af99-8384ff6cf4fc req-0c1e23ae-3fdc-47a7-9ca0-d4ccb4ffb1ca service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-af3a07d2-277e-4367-af99-8384ff6cf4fc req-0c1e23ae-3fdc-47a7-9ca0-d4ccb4ffb1ca service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] No waiting events found dispatching network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:56:42 user nova-compute[75288]: WARNING nova.compute.manager [req-af3a07d2-277e-4367-af99-8384ff6cf4fc req-0c1e23ae-3fdc-47a7-9ca0-d4ccb4ffb1ca service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received unexpected event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b for instance with vm_state active and task_state resize_migrated.
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquired lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating instance_info_cache with network_info: [{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Releasing lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG os_brick.utils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba677277-ea48-4988-bea6-d95af9c6fa9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[13877679-f09a-48f2-ad1f-1e16c44453a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c74659-c425-43cc-b6a8-6293a7d3818c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8de543-a758-4563-8f63-c4dd48af332a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:56:43 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:56:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a75980-bf46-4cc5-986c-3f0cf9bddfec]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:56:43 user nova-compute[75288]: DEBUG os_brick.utils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:56:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Starting finish_migration {{(pid=75288) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 13:56:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Creating image(s)
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Ensure instance console log exists: /opt/stack/data/nova/instances/b4211312-8a32-4723-801d-47c3db348668/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Start _get_guest_xml network_info=[{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1934493457-network", "vif_mac": "fa:16:3e:35:47:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c885c658-9a97-41eb-ba04-1c2e424394fe', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjbTQnir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b4211312-8a32-4723-801d-47c3db348668', 'attached_at': '2023-12-01T13:56:52.000000', 'detached_at': '', 'volume_id': '5d75223d-31e1-4691-98bd-d039f7ec5260', 'serial': '5d75223d-31e1-4691-98bd-d039f7ec5260'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:56:52 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:56:52 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjbTQnir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:56:52 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:56:52 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:56:52 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c6a014-4100-4c98-a028-10b48d411988]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:56:52 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac77d65-7914-4db9-b2ad-2befdb8272c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260] added
Dec 01 13:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e53c6-f10d-43d9-9dfc-f710c2f0817b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3abcb0-d708-448a-a34d-07ad1399a8bf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjbTQnir {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjbTQnir" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c3acce-3d70-493b-847b-1a3badf97d67]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjbTQnir'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb1d45f-0470-4828-bb81-91ca2bc0c1cd]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0059409f-6e29-4ac3-b728-5587dd171dd5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:52 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:52 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabb14e2-f839-4252-8f7e-b3b436b50681]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260]
Dec 01 13:56:52 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260] successful.
Dec 01 13:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9e3521-3a69-4a70-9b64-58519031925e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2292c-74d6-4964-a111-52c42bb05ae1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:52 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:52 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:56:52 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:56:52 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:56:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37c0434-a775-4b31-b811-ab067aa511a6]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:56:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjbTQnir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23630336161323237', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630336161323237', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1258491341',display_name='tempest-ServerActionsTestOtherA-server-1258491341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1258491341',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:55:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-75q0eqf8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:56:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=b4211312-8a32-4723-801d-47c3db348668,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1934493457-network", "vif_mac": "fa:16:3e:35:47:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1934493457-network", "vif_mac": "fa:16:3e:35:47:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:56:53 user nova-compute[75288]:   <uuid>b4211312-8a32-4723-801d-47c3db348668</uuid>
Dec 01 13:56:53 user nova-compute[75288]:   <name>instance-00000020</name>
Dec 01 13:56:53 user nova-compute[75288]:   <memory>2097152</memory>
Dec 01 13:56:53 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:56:53 user nova-compute[75288]:   <metadata>
Dec 01 13:56:53 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:56:53 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:56:53 user nova-compute[75288]:       <nova:name>tempest-ServerActionsTestOtherA-server-1258491341</nova:name>
Dec 01 13:56:53 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:56:52</nova:creationTime>
Dec 01 13:56:53 user nova-compute[75288]:       <nova:flavor name="m1.small">
Dec 01 13:56:53 user nova-compute[75288]:         <nova:memory>2048</nova:memory>
Dec 01 13:56:53 user nova-compute[75288]:         <nova:disk>20</nova:disk>
Dec 01 13:56:53 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:56:53 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:56:53 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:56:53 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:56:53 user nova-compute[75288]:       <nova:owner>
Dec 01 13:56:53 user nova-compute[75288]:         <nova:user uuid="5a8b600efb9d47b6991cbde8b34b9a1f">tempest-ServerActionsTestOtherA-1200563250-project-member</nova:user>
Dec 01 13:56:53 user nova-compute[75288]:         <nova:project uuid="85fa93e7dad94355a81ee3193a26d19a">tempest-ServerActionsTestOtherA-1200563250</nova:project>
Dec 01 13:56:53 user nova-compute[75288]:       </nova:owner>
Dec 01 13:56:53 user nova-compute[75288]:       <nova:ports>
Dec 01 13:56:53 user nova-compute[75288]:         <nova:port uuid="830b3d65-26cd-4266-a4a7-67dd9cf6dd5b">
Dec 01 13:56:53 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 13:56:53 user nova-compute[75288]:         </nova:port>
Dec 01 13:56:53 user nova-compute[75288]:       </nova:ports>
Dec 01 13:56:53 user nova-compute[75288]:     </nova:instance>
Dec 01 13:56:53 user nova-compute[75288]:   </metadata>
Dec 01 13:56:53 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:56:53 user nova-compute[75288]:     <system>
Dec 01 13:56:53 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:56:53 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:56:53 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:56:53 user nova-compute[75288]:       <entry name="serial">b4211312-8a32-4723-801d-47c3db348668</entry>
Dec 01 13:56:53 user nova-compute[75288]:       <entry name="uuid">b4211312-8a32-4723-801d-47c3db348668</entry>
Dec 01 13:56:53 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:56:53 user nova-compute[75288]:     </system>
Dec 01 13:56:53 user nova-compute[75288]:   </sysinfo>
Dec 01 13:56:53 user nova-compute[75288]:   <os>
Dec 01 13:56:53 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:56:53 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:56:53 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:56:53 user nova-compute[75288]:   </os>
Dec 01 13:56:53 user nova-compute[75288]:   <features>
Dec 01 13:56:53 user nova-compute[75288]:     <acpi/>
Dec 01 13:56:53 user nova-compute[75288]:     <apic/>
Dec 01 13:56:53 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:56:53 user nova-compute[75288]:   </features>
Dec 01 13:56:53 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:56:53 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:56:53 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:56:53 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:56:53 user nova-compute[75288]:   </clock>
Dec 01 13:56:53 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:56:53 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:56:53 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:56:53 user nova-compute[75288]:   </cpu>
Dec 01 13:56:53 user nova-compute[75288]:   <devices>
Dec 01 13:56:53 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:56:53 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:56:53 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Dec 01 13:56:53 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:56:53 user nova-compute[75288]:       <serial>5d75223d-31e1-4691-98bd-d039f7ec5260</serial>
Dec 01 13:56:53 user nova-compute[75288]:     </disk>
Dec 01 13:56:53 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:56:53 user nova-compute[75288]:       <mac address="fa:16:3e:35:47:eb"/>
Dec 01 13:56:53 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:56:53 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:56:53 user nova-compute[75288]:       <target dev="tap830b3d65-26"/>
Dec 01 13:56:53 user nova-compute[75288]:     </interface>
Dec 01 13:56:53 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:56:53 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/b4211312-8a32-4723-801d-47c3db348668/console.log" append="off"/>
Dec 01 13:56:53 user nova-compute[75288]:     </serial>
Dec 01 13:56:53 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:56:53 user nova-compute[75288]:     <video>
Dec 01 13:56:53 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:56:53 user nova-compute[75288]:     </video>
Dec 01 13:56:53 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:56:53 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:56:53 user nova-compute[75288]:     </rng>
Dec 01 13:56:53 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:56:53 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:56:53 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:56:53 user nova-compute[75288]:     </memballoon>
Dec 01 13:56:53 user nova-compute[75288]:   </devices>
Dec 01 13:56:53 user nova-compute[75288]: </domain>
Dec 01 13:56:53 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1258491341',display_name='tempest-ServerActionsTestOtherA-server-1258491341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1258491341',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:55:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-75q0eqf8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:56:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=b4211312-8a32-4723-801d-47c3db348668,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1934493457-network", "vif_mac": "fa:16:3e:35:47:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1934493457-network", "vif_mac": "fa:16:3e:35:47:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG os_vif [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f813952d-79ad-5b2b-8cee-46a8ad290f19', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap830b3d65-26, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap830b3d65-26, col_values=(('qos', UUID('3a79b86d-76f9-4337-8dfc-9e334a7b4bb5')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap830b3d65-26, col_values=(('external_ids', {'iface-id': '830b3d65-26cd-4266-a4a7-67dd9cf6dd5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:47:eb', 'vm-uuid': 'b4211312-8a32-4723-801d-47c3db348668'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:53 user nova-compute[75288]: INFO os_vif [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26')
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:56:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] No VIF found with MAC fa:16:3e:35:47:eb, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-cfd4d943-bca4-4557-a7fc-8beafa63d992 req-5ce85b19-af87-492f-b9da-8dcdf5aa8b38 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfd4d943-bca4-4557-a7fc-8beafa63d992 req-5ce85b19-af87-492f-b9da-8dcdf5aa8b38 service nova] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfd4d943-bca4-4557-a7fc-8beafa63d992 req-5ce85b19-af87-492f-b9da-8dcdf5aa8b38 service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cfd4d943-bca4-4557-a7fc-8beafa63d992 req-5ce85b19-af87-492f-b9da-8dcdf5aa8b38 service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-cfd4d943-bca4-4557-a7fc-8beafa63d992 req-5ce85b19-af87-492f-b9da-8dcdf5aa8b38 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] No waiting events found dispatching network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:56:55 user nova-compute[75288]: WARNING nova.compute.manager [req-cfd4d943-bca4-4557-a7fc-8beafa63d992 req-5ce85b19-af87-492f-b9da-8dcdf5aa8b38 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received unexpected event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b for instance with vm_state active and task_state resize_finish.
Dec 01 13:56:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:56:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance running successfully.
Dec 01 13:56:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Failed to set time: agent not configured {{(pid=75288) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3f22703d-e74a-42f5-b369-f3e069739b36 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] finish_migration finished successfully. {{(pid=75288) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b266a2c-3bed-4643-8b8c-253cfbbf82cc req-a8075890-09ad-4ba8-923a-3da0475669fe service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b266a2c-3bed-4643-8b8c-253cfbbf82cc req-a8075890-09ad-4ba8-923a-3da0475669fe service nova] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b266a2c-3bed-4643-8b8c-253cfbbf82cc req-a8075890-09ad-4ba8-923a-3da0475669fe service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b266a2c-3bed-4643-8b8c-253cfbbf82cc req-a8075890-09ad-4ba8-923a-3da0475669fe service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b266a2c-3bed-4643-8b8c-253cfbbf82cc req-a8075890-09ad-4ba8-923a-3da0475669fe service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] No waiting events found dispatching network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:56:57 user nova-compute[75288]: WARNING nova.compute.manager [req-0b266a2c-3bed-4643-8b8c-253cfbbf82cc req-a8075890-09ad-4ba8-923a-3da0475669fe service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received unexpected event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b for instance with vm_state resized and task_state None.
Dec 01 13:56:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-b2e44b47-013b-4456-9620-02f4af5375a0 req-e110e111-ef86-414f-8214-89bcae05e6a0 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-changed-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-b2e44b47-013b-4456-9620-02f4af5375a0 req-e110e111-ef86-414f-8214-89bcae05e6a0 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Refreshing instance network info cache due to event network-changed-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b2e44b47-013b-4456-9620-02f4af5375a0 req-e110e111-ef86-414f-8214-89bcae05e6a0 service nova] Acquiring lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b2e44b47-013b-4456-9620-02f4af5375a0 req-e110e111-ef86-414f-8214-89bcae05e6a0 service nova] Acquired lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:56:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-b2e44b47-013b-4456-9620-02f4af5375a0 req-e110e111-ef86-414f-8214-89bcae05e6a0 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Refreshing network info cache for port dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-b2e44b47-013b-4456-9620-02f4af5375a0 req-e110e111-ef86-414f-8214-89bcae05e6a0 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updated VIF entry in instance network info cache for port dd2bd589-71cc-43dd-929f-8ccc0cb15d5e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-b2e44b47-013b-4456-9620-02f4af5375a0 req-e110e111-ef86-414f-8214-89bcae05e6a0 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updating instance_info_cache with network_info: [{"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b2e44b47-013b-4456-9620-02f4af5375a0 req-e110e111-ef86-414f-8214-89bcae05e6a0 service nova] Releasing lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'flavor' on Instance uuid 60ed46b9-cae1-4bd5-bd37-6fdada399023 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:56:58 user nova-compute[75288]: INFO nova.compute.manager [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Attaching volume c8fdbc69-7ea5-4097-8700-09e5c3258a68 to /dev/vdb
Dec 01 13:56:58 user nova-compute[75288]: DEBUG os_brick.utils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b1ea86-553c-42fe-96d0-eb424ba41430]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[36002b46-5271-4e47-9908-c7b0c98be503]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9088671-bec4-458f-9c2b-e29481691723]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7c76b1-1797-4c9e-8e78-68ad889b0038]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:56:58 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:56:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14a9ceb-081b-42e0-890a-66a0626f365a]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG os_brick.utils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updating existing volume attachment record: a64c1a44-4da2-4636-98c3-1777a264a2d2 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:56:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrQByYaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:57:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:57:08 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:57:08 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1946140e-2e55-4e5e-b74a-b8e479d1db4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:57:08 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed64ac4-0ff8-4d3d-bb9d-ccb772d7794e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68] added
Dec 01 13:57:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7203fc-335b-440f-bc0b-1036664f9b52]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4ba551-27d8-4438-b6fd-247dd3dde3a4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrQByYaI {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrQByYaI" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783938d-942c-4c11-82a7-990c5ff2c8c5]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LrQByYaI'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[78268b59-d4b9-4af0-a034-53302cb5d189]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[781aaa05-cdc6-4c15-afbd-5da9c64aeb42]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb3ca3b-8aea-4287-aa71-2689473e28c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68, portal: 172.16.0.220,3260]
Dec 01 13:57:08 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68, portal: 172.16.0.220,3260] successful.
Dec 01 13:57:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8353e1b-17d9-4d55-a832-8045b8e01b95]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fa879f-a8b5-438e-aa4f-c87bc753842c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 (non-flash)
Dec 01 13:57:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:08 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 (non-flash)
Dec 01 13:57:08 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecf8bec-726d-4546-85a0-82747f386c18]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrQByYaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:57:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:57:09 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26131623765303537', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:57:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131623765303537', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:57:09 user nova-compute[75288]: DEBUG nova.objects.instance [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'flavor' on Instance uuid 60ed46b9-cae1-4bd5-bd37-6fdada399023 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:57:09 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:57:09 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:57:09 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:57:09 user nova-compute[75288]:   <serial>c8fdbc69-7ea5-4097-8700-09e5c3258a68</serial>
Dec 01 13:57:09 user nova-compute[75288]: </disk>
Dec 01 13:57:09 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:57:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:57:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:57:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No VIF found with MAC fa:16:3e:79:15:90, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:57:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-306c0d63-ff5a-41b5-aca7-8c1c47270111 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.697s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:12 user nova-compute[75288]: INFO nova.compute.manager [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Detaching volume c8fdbc69-7ea5-4097-8700-09e5c3258a68
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:12 user nova-compute[75288]: INFO nova.virt.block_device [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Attempting to driver detach volume c8fdbc69-7ea5-4097-8700-09e5c3258a68 from mountpoint /dev/vdb
Dec 01 13:57:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Attempting to detach device vdb from instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:57:12 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:57:12 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:57:12 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:57:12 user nova-compute[75288]:   <serial>c8fdbc69-7ea5-4097-8700-09e5c3258a68</serial>
Dec 01 13:57:12 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:57:12 user nova-compute[75288]: </disk>
Dec 01 13:57:12 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:57:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Successfully detached device vdb from instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 from the persistent domain config.
Dec 01 13:57:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:57:12 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:57:12 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:57:12 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:57:12 user nova-compute[75288]:   <serial>c8fdbc69-7ea5-4097-8700-09e5c3258a68</serial>
Dec 01 13:57:12 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:57:12 user nova-compute[75288]: </disk>
Dec 01 13:57:12 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:57:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:16 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:57:16 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=25.112350463867188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Applying migration context for instance b4211312-8a32-4723-801d-47c3db348668 as it has an incoming, in-progress migration 8c968267-54c3-4c6a-9015-6876a33f7b69. Migration status is finished {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 13:57:16 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating resource usage from migration 8c968267-54c3-4c6a-9015-6876a33f7b69
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ce476b0b-4ed7-42bc-9801-860255953006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Migration 8c968267-54c3-4c6a-9015-6876a33f7b69 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b4211312-8a32-4723-801d-47c3db348668 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:57:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:57:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 03de2627-2167-48c9-94cb-bd57c18f87c8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [{"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-03de2627-2167-48c9-94cb-bd57c18f87c8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:57:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:57:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:22 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:57:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:57:24 user nova-compute[75288]: INFO nova.compute.claims [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Claim successful on node user
Dec 01 13:57:24 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:57:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:57:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:57:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:57:25 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Creating image(s)
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "/opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "/opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG nova.policy [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69266afe5e404e259d679d7498f99faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6b677b10d14d63984895b4cfbdad4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk 1073741824" returned: 0 in 0.063s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:25 user nova-compute[75288]: INFO nova.compute.manager [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Unshelving
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Cannot resize image /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Ensure instance console log exists: /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:26 user nova-compute[75288]: INFO nova.virt.block_device [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Booting with volume 8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a at /dev/vdc
Dec 01 13:57:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a204bfbb-f9f0-4d84-bc50-2c4a9abbd5d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5aa3b9-66c6-438b-8720-67fed8c77ab8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa14334d-6dc5-417f-9034-b9e9c4b985bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6515ab0-cfa5-498c-91e9-ec8712fdb880]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:57:26 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19848688-a975-4557-beed-bca0421a5bb1]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG os_brick.utils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating existing volume attachment record: 81638f7f-a61a-4198-b3f2-34ae9d2b7ed9 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Successfully created port: 283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:57:26 user nova-compute[75288]: INFO nova.compute.claims [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Claim successful on node user
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Successfully updated port: 283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquired lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-9615fb38-cba9-459d-9971-68d50d2295cf req-c53cefb5-29ff-4430-bda0-50244c7525e0 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received event network-changed-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.compute.manager [req-9615fb38-cba9-459d-9971-68d50d2295cf req-c53cefb5-29ff-4430-bda0-50244c7525e0 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Refreshing instance network info cache due to event network-changed-283c4c88-4aa8-4933-9147-8510f5b381d5. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9615fb38-cba9-459d-9971-68d50d2295cf req-c53cefb5-29ff-4430-bda0-50244c7525e0 service nova] Acquiring lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Updating instance_info_cache with network_info: [{"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Releasing lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Instance network_info: |[{"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9615fb38-cba9-459d-9971-68d50d2295cf req-c53cefb5-29ff-4430-bda0-50244c7525e0 service nova] Acquired lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-9615fb38-cba9-459d-9971-68d50d2295cf req-c53cefb5-29ff-4430-bda0-50244c7525e0 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Refreshing network info cache for port 283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Start _get_guest_xml network_info=[{"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:57:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:57:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1794077369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1794077369',id=34,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-lgkqtiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:57:25Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=8a0ae420-3d13-48e9-88fa-432b97c27a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:be:25,bridge_name='br-int',has_traffic_filtering=True,id=283c4c88-4aa8-4933-9147-8510f5b381d5,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4c88-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a0ae420-3d13-48e9-88fa-432b97c27a28 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:57:27 user nova-compute[75288]:   <uuid>8a0ae420-3d13-48e9-88fa-432b97c27a28</uuid>
Dec 01 13:57:27 user nova-compute[75288]:   <name>instance-00000022</name>
Dec 01 13:57:27 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:57:27 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:57:27 user nova-compute[75288]:   <metadata>
Dec 01 13:57:27 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:57:27 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:57:27 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1794077369</nova:name>
Dec 01 13:57:27 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:57:27</nova:creationTime>
Dec 01 13:57:27 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:57:27 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:57:27 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:57:27 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:57:27 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:57:27 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:57:27 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:57:27 user nova-compute[75288]:       <nova:owner>
Dec 01 13:57:27 user nova-compute[75288]:         <nova:user uuid="69266afe5e404e259d679d7498f99faa">tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member</nova:user>
Dec 01 13:57:27 user nova-compute[75288]:         <nova:project uuid="2e6b677b10d14d63984895b4cfbdad4b">tempest-ServerBootFromVolumeStableRescueTest-64531845</nova:project>
Dec 01 13:57:27 user nova-compute[75288]:       </nova:owner>
Dec 01 13:57:27 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:57:27 user nova-compute[75288]:       <nova:ports>
Dec 01 13:57:27 user nova-compute[75288]:         <nova:port uuid="283c4c88-4aa8-4933-9147-8510f5b381d5">
Dec 01 13:57:27 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 13:57:27 user nova-compute[75288]:         </nova:port>
Dec 01 13:57:27 user nova-compute[75288]:       </nova:ports>
Dec 01 13:57:27 user nova-compute[75288]:     </nova:instance>
Dec 01 13:57:27 user nova-compute[75288]:   </metadata>
Dec 01 13:57:27 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:57:27 user nova-compute[75288]:     <system>
Dec 01 13:57:27 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:57:27 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:57:27 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:57:27 user nova-compute[75288]:       <entry name="serial">8a0ae420-3d13-48e9-88fa-432b97c27a28</entry>
Dec 01 13:57:27 user nova-compute[75288]:       <entry name="uuid">8a0ae420-3d13-48e9-88fa-432b97c27a28</entry>
Dec 01 13:57:27 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:57:27 user nova-compute[75288]:     </system>
Dec 01 13:57:27 user nova-compute[75288]:   </sysinfo>
Dec 01 13:57:27 user nova-compute[75288]:   <os>
Dec 01 13:57:27 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:57:27 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:57:27 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:57:27 user nova-compute[75288]:   </os>
Dec 01 13:57:27 user nova-compute[75288]:   <features>
Dec 01 13:57:27 user nova-compute[75288]:     <acpi/>
Dec 01 13:57:27 user nova-compute[75288]:     <apic/>
Dec 01 13:57:27 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:57:27 user nova-compute[75288]:   </features>
Dec 01 13:57:27 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:57:27 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:57:27 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:57:27 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:57:27 user nova-compute[75288]:   </clock>
Dec 01 13:57:27 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:57:27 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:57:27 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:57:27 user nova-compute[75288]:   </cpu>
Dec 01 13:57:27 user nova-compute[75288]:   <devices>
Dec 01 13:57:27 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:57:27 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:57:27 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk"/>
Dec 01 13:57:27 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:57:27 user nova-compute[75288]:     </disk>
Dec 01 13:57:27 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:57:27 user nova-compute[75288]:       <mac address="fa:16:3e:ca:be:25"/>
Dec 01 13:57:27 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:57:27 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:57:27 user nova-compute[75288]:       <target dev="tap283c4c88-4a"/>
Dec 01 13:57:27 user nova-compute[75288]:     </interface>
Dec 01 13:57:27 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:57:27 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/console.log" append="off"/>
Dec 01 13:57:27 user nova-compute[75288]:     </serial>
Dec 01 13:57:27 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:57:27 user nova-compute[75288]:     <video>
Dec 01 13:57:27 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:57:27 user nova-compute[75288]:     </video>
Dec 01 13:57:27 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:57:27 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:57:27 user nova-compute[75288]:     </rng>
Dec 01 13:57:27 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:57:27 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:57:27 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:57:27 user nova-compute[75288]:     </memballoon>
Dec 01 13:57:27 user nova-compute[75288]:   </devices>
Dec 01 13:57:27 user nova-compute[75288]: </domain>
Dec 01 13:57:27 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1794077369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1794077369',id=34,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-lgkqtiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:57:25Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=8a0ae420-3d13-48e9-88fa-432b97c27a28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:be:25,bridge_name='br-int',has_traffic_filtering=True,id=283c4c88-4aa8-4933-9147-8510f5b381d5,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4c88-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG os_vif [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:be:25,bridge_name='br-int',has_traffic_filtering=True,id=283c4c88-4aa8-4933-9147-8510f5b381d5,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4c88-4a') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ab4c587-ca5d-55e8-b4eb-5c910bc6f613', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap283c4c88-4a, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap283c4c88-4a, col_values=(('qos', UUID('ef1c0afd-2ef3-416a-959a-4d51aa69f5e7')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap283c4c88-4a, col_values=(('external_ids', {'iface-id': '283c4c88-4aa8-4933-9147-8510f5b381d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:be:25', 'vm-uuid': '8a0ae420-3d13-48e9-88fa-432b97c27a28'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:27 user nova-compute[75288]: INFO os_vif [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:be:25,bridge_name='br-int',has_traffic_filtering=True,id=283c4c88-4aa8-4933-9147-8510f5b381d5,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4c88-4a')
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:57:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No VIF found with MAC fa:16:3e:ca:be:25, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.policy [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e384ef4f5a36497d8e805cf7cc87f32e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab33b0750b8b4f199df0d6dfe6136a8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:57:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Creating image(s)
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "/opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "/opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "/opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-9615fb38-cba9-459d-9971-68d50d2295cf req-c53cefb5-29ff-4430-bda0-50244c7525e0 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Updated VIF entry in instance network info cache for port 283c4c88-4aa8-4933-9147-8510f5b381d5. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG nova.network.neutron [req-9615fb38-cba9-459d-9971-68d50d2295cf req-c53cefb5-29ff-4430-bda0-50244c7525e0 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Updating instance_info_cache with network_info: [{"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9615fb38-cba9-459d-9971-68d50d2295cf req-c53cefb5-29ff-4430-bda0-50244c7525e0 service nova] Releasing lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk 1073741824" returned: 0 in 0.070s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Successfully created port: c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Cannot resize image /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Ensure instance console log exists: /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Successfully updated port: c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquired lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-85d4b323-44a2-4133-a303-23d86c1f2f71 req-e8c9bd9f-12e8-40b7-8c7e-7e1963a68a5a service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received event network-changed-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-85d4b323-44a2-4133-a303-23d86c1f2f71 req-e8c9bd9f-12e8-40b7-8c7e-7e1963a68a5a service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Refreshing instance network info cache due to event network-changed-c235bd4e-196b-47ad-902e-a5712bf7fbc7. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85d4b323-44a2-4133-a303-23d86c1f2f71 req-e8c9bd9f-12e8-40b7-8c7e-7e1963a68a5a service nova] Acquiring lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Updating instance_info_cache with network_info: [{"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Releasing lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Instance network_info: |[{"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85d4b323-44a2-4133-a303-23d86c1f2f71 req-e8c9bd9f-12e8-40b7-8c7e-7e1963a68a5a service nova] Acquired lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.neutron [req-85d4b323-44a2-4133-a303-23d86c1f2f71 req-e8c9bd9f-12e8-40b7-8c7e-7e1963a68a5a service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Refreshing network info cache for port c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Start _get_guest_xml network_info=[{"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:57:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:57:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-633634409',display_name='tempest-VolumesSnapshotTestJSON-instance-633634409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-633634409',id=35,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgKL5em/ivjbwZMwym+Tr+x+AAFQ1pf7lOFalgLApmwrAMp8vsOWXa2i1lB1urZrzzkj4ZDOuG3NZrYho4oI1MQNiDcJlsqb55Isi+8zoYfpQL1kfy6BFuTW8Wy8dWZ6A==',key_name='tempest-keypair-1544437578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab33b0750b8b4f199df0d6dfe6136a8b',ramdisk_id='',reservation_id='r-pvjht3yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-383967549',owner_user_name='tempest-VolumesSnapshotTestJSON-383967549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e384ef4f5a36497d8e805cf7cc87f32e',uuid=f64339c5-e6e5-4dbb-812f-e16f2acdd03b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converting VIF {"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=c235bd4e-196b-47ad-902e-a5712bf7fbc7,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc235bd4e-19') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'pci_devices' on Instance uuid f64339c5-e6e5-4dbb-812f-e16f2acdd03b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:57:29 user nova-compute[75288]:   <uuid>f64339c5-e6e5-4dbb-812f-e16f2acdd03b</uuid>
Dec 01 13:57:29 user nova-compute[75288]:   <name>instance-00000023</name>
Dec 01 13:57:29 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:57:29 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:57:29 user nova-compute[75288]:   <metadata>
Dec 01 13:57:29 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:57:29 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:57:29 user nova-compute[75288]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-633634409</nova:name>
Dec 01 13:57:29 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:57:29</nova:creationTime>
Dec 01 13:57:29 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:57:29 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:57:29 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:57:29 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:57:29 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:57:29 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:57:29 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:57:29 user nova-compute[75288]:       <nova:owner>
Dec 01 13:57:29 user nova-compute[75288]:         <nova:user uuid="e384ef4f5a36497d8e805cf7cc87f32e">tempest-VolumesSnapshotTestJSON-383967549-project-member</nova:user>
Dec 01 13:57:29 user nova-compute[75288]:         <nova:project uuid="ab33b0750b8b4f199df0d6dfe6136a8b">tempest-VolumesSnapshotTestJSON-383967549</nova:project>
Dec 01 13:57:29 user nova-compute[75288]:       </nova:owner>
Dec 01 13:57:29 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 13:57:29 user nova-compute[75288]:       <nova:ports>
Dec 01 13:57:29 user nova-compute[75288]:         <nova:port uuid="c235bd4e-196b-47ad-902e-a5712bf7fbc7">
Dec 01 13:57:29 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 13:57:29 user nova-compute[75288]:         </nova:port>
Dec 01 13:57:29 user nova-compute[75288]:       </nova:ports>
Dec 01 13:57:29 user nova-compute[75288]:     </nova:instance>
Dec 01 13:57:29 user nova-compute[75288]:   </metadata>
Dec 01 13:57:29 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:57:29 user nova-compute[75288]:     <system>
Dec 01 13:57:29 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:57:29 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:57:29 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:57:29 user nova-compute[75288]:       <entry name="serial">f64339c5-e6e5-4dbb-812f-e16f2acdd03b</entry>
Dec 01 13:57:29 user nova-compute[75288]:       <entry name="uuid">f64339c5-e6e5-4dbb-812f-e16f2acdd03b</entry>
Dec 01 13:57:29 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:57:29 user nova-compute[75288]:     </system>
Dec 01 13:57:29 user nova-compute[75288]:   </sysinfo>
Dec 01 13:57:29 user nova-compute[75288]:   <os>
Dec 01 13:57:29 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:57:29 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:57:29 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:57:29 user nova-compute[75288]:   </os>
Dec 01 13:57:29 user nova-compute[75288]:   <features>
Dec 01 13:57:29 user nova-compute[75288]:     <acpi/>
Dec 01 13:57:29 user nova-compute[75288]:     <apic/>
Dec 01 13:57:29 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:57:29 user nova-compute[75288]:   </features>
Dec 01 13:57:29 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:57:29 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:57:29 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:57:29 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:57:29 user nova-compute[75288]:   </clock>
Dec 01 13:57:29 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:57:29 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:57:29 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:57:29 user nova-compute[75288]:   </cpu>
Dec 01 13:57:29 user nova-compute[75288]:   <devices>
Dec 01 13:57:29 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:57:29 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:57:29 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk"/>
Dec 01 13:57:29 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:57:29 user nova-compute[75288]:     </disk>
Dec 01 13:57:29 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:57:29 user nova-compute[75288]:       <mac address="fa:16:3e:af:13:1b"/>
Dec 01 13:57:29 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:57:29 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:57:29 user nova-compute[75288]:       <target dev="tapc235bd4e-19"/>
Dec 01 13:57:29 user nova-compute[75288]:     </interface>
Dec 01 13:57:29 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:57:29 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/console.log" append="off"/>
Dec 01 13:57:29 user nova-compute[75288]:     </serial>
Dec 01 13:57:29 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:57:29 user nova-compute[75288]:     <video>
Dec 01 13:57:29 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:57:29 user nova-compute[75288]:     </video>
Dec 01 13:57:29 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:57:29 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:57:29 user nova-compute[75288]:     </rng>
Dec 01 13:57:29 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:57:29 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:57:29 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:57:29 user nova-compute[75288]:     </memballoon>
Dec 01 13:57:29 user nova-compute[75288]:   </devices>
Dec 01 13:57:29 user nova-compute[75288]: </domain>
Dec 01 13:57:29 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-633634409',display_name='tempest-VolumesSnapshotTestJSON-instance-633634409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-633634409',id=35,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgKL5em/ivjbwZMwym+Tr+x+AAFQ1pf7lOFalgLApmwrAMp8vsOWXa2i1lB1urZrzzkj4ZDOuG3NZrYho4oI1MQNiDcJlsqb55Isi+8zoYfpQL1kfy6BFuTW8Wy8dWZ6A==',key_name='tempest-keypair-1544437578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab33b0750b8b4f199df0d6dfe6136a8b',ramdisk_id='',reservation_id='r-pvjht3yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-383967549',owner_user_name='tempest-VolumesSnapshotTestJSON-383967549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e384ef4f5a36497d8e805cf7cc87f32e',uuid=f64339c5-e6e5-4dbb-812f-e16f2acdd03b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converting VIF {"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=c235bd4e-196b-47ad-902e-a5712bf7fbc7,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc235bd4e-19') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG os_vif [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=c235bd4e-196b-47ad-902e-a5712bf7fbc7,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc235bd4e-19') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f48c1d9c-718e-5e8e-9b90-2302f883a853', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc235bd4e-19, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc235bd4e-19, col_values=(('qos', UUID('c700bb6f-d3ec-47bf-a63e-7f7ff0e310a3')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc235bd4e-19, col_values=(('external_ids', {'iface-id': 'c235bd4e-196b-47ad-902e-a5712bf7fbc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:13:1b', 'vm-uuid': 'f64339c5-e6e5-4dbb-812f-e16f2acdd03b'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:29 user nova-compute[75288]: INFO os_vif [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=c235bd4e-196b-47ad-902e-a5712bf7fbc7,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc235bd4e-19')
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:57:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No VIF found with MAC fa:16:3e:af:13:1b, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:57:30 user nova-compute[75288]: DEBUG nova.network.neutron [req-85d4b323-44a2-4133-a303-23d86c1f2f71 req-e8c9bd9f-12e8-40b7-8c7e-7e1963a68a5a service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Updated VIF entry in instance network info cache for port c235bd4e-196b-47ad-902e-a5712bf7fbc7. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:57:30 user nova-compute[75288]: DEBUG nova.network.neutron [req-85d4b323-44a2-4133-a303-23d86c1f2f71 req-e8c9bd9f-12e8-40b7-8c7e-7e1963a68a5a service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Updating instance_info_cache with network_info: [{"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-85d4b323-44a2-4133-a303-23d86c1f2f71 req-e8c9bd9f-12e8-40b7-8c7e-7e1963a68a5a service nova] Releasing lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:57:31 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Instance spawned successfully.
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received event network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] Acquiring lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] No waiting events found dispatching network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:57:31 user nova-compute[75288]: WARNING nova.compute.manager [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received unexpected event network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 for instance with vm_state building and task_state spawning.
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received event network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] Acquiring lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] No waiting events found dispatching network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:57:31 user nova-compute[75288]: WARNING nova.compute.manager [req-77ebf330-fce1-4b6f-bf8c-66d9424d1bfc req-741fbafb-8379-4b9a-bd6a-f5eaf77719fd service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received unexpected event network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 for instance with vm_state building and task_state spawning.
Dec 01 13:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:31 user nova-compute[75288]: INFO nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Took 6.22 seconds to spawn the instance on the hypervisor.
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:57:31 user nova-compute[75288]: INFO nova.compute.manager [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Took 7.01 seconds to build instance.
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f64d278c-33a9-4ba9-a5b0-46671c374fd2 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.110s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9ab2981-cb94-48e9-a089-719d4f4c7415 req-c6e6b4b0-a1f1-4434-a215-f23a81965da7 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received event network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9ab2981-cb94-48e9-a089-719d4f4c7415 req-c6e6b4b0-a1f1-4434-a215-f23a81965da7 service nova] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9ab2981-cb94-48e9-a089-719d4f4c7415 req-c6e6b4b0-a1f1-4434-a215-f23a81965da7 service nova] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9ab2981-cb94-48e9-a089-719d4f4c7415 req-c6e6b4b0-a1f1-4434-a215-f23a81965da7 service nova] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9ab2981-cb94-48e9-a089-719d4f4c7415 req-c6e6b4b0-a1f1-4434-a215-f23a81965da7 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] No waiting events found dispatching network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:57:31 user nova-compute[75288]: WARNING nova.compute.manager [req-f9ab2981-cb94-48e9-a089-719d4f4c7415 req-c6e6b4b0-a1f1-4434-a215-f23a81965da7 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received unexpected event network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 for instance with vm_state building and task_state spawning.
Dec 01 13:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:32 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 is timed out.
Dec 01 13:57:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Successfully detached device vdb from instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 from the live domain config.
Dec 01 13:57:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrQByYaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:57:32 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:57:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[702143d1-192c-4c8c-9b0d-177dc0c5450c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:57:32 user nova-compute[75288]: No targets found.
Dec 01 13:57:32 user nova-compute[75288]: iSNS:
Dec 01 13:57:32 user nova-compute[75288]: No targets found.
Dec 01 13:57:32 user nova-compute[75288]: STATIC:
Dec 01 13:57:32 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68
Dec 01 13:57:32 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:57:32 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:57:32 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef
Dec 01 13:57:32 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:57:32 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:57:32 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:57:32 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:57:32 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:57:32 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 13:57:32 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:57:32 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:57:32 user nova-compute[75288]: FIRMWARE:
Dec 01 13:57:32 user nova-compute[75288]: No targets found.
Dec 01 13:57:32 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:57:32 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:57:32 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[313c55c5-1a7a-4b7f-997f-4f9bf996c885]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da46e9-f25e-4d97-af11-f579516a4dc0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:33 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:33 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:33 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 (non-flash)
Dec 01 13:57:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:33 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:33 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:33 user nova-compute[75288]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 (non-flash)
Dec 01 13:57:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc692950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3601048-a17e-4d59-aed7-07f70f73b4d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e1eeaa-4b33-4987-8cc1-e0cbf0d83948]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7ae338-c1f3-4812-92d8-1a2c8225a01f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ee74e8-170e-4197-87c0-0feb14bcb7b6]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d594c46-10b7-42df-b6d9-b8458bd5b900]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79dca59-2501-417e-9014-27a7bf1ae467]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68, portal: 172.16.0.220,3260]
Dec 01 13:57:33 user nova-compute[75288]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68, portal: 172.16.0.220,3260] successful.
Dec 01 13:57:33 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8fdbc69-7ea5-4097-8700-09e5c3258a68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[340fe4da-cb8b-44d6-ae53-d76cfe97caf0]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] <== disconnect_volume: return (321ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:57:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Instance spawned successfully.
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9a24d72-2539-4199-b402-b8a4c7ce8e99 req-b247cb96-3baf-4cbc-b8ea-d25529931e79 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received event network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9a24d72-2539-4199-b402-b8a4c7ce8e99 req-b247cb96-3baf-4cbc-b8ea-d25529931e79 service nova] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9a24d72-2539-4199-b402-b8a4c7ce8e99 req-b247cb96-3baf-4cbc-b8ea-d25529931e79 service nova] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a9a24d72-2539-4199-b402-b8a4c7ce8e99 req-b247cb96-3baf-4cbc-b8ea-d25529931e79 service nova] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [req-a9a24d72-2539-4199-b402-b8a4c7ce8e99 req-b247cb96-3baf-4cbc-b8ea-d25529931e79 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] No waiting events found dispatching network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:57:33 user nova-compute[75288]: WARNING nova.compute.manager [req-a9a24d72-2539-4199-b402-b8a4c7ce8e99 req-b247cb96-3baf-4cbc-b8ea-d25529931e79 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received unexpected event network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 for instance with vm_state building and task_state spawning.
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:57:33 user nova-compute[75288]: INFO nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Took 5.94 seconds to spawn the instance on the hypervisor.
Dec 01 13:57:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:57:33 user nova-compute[75288]: INFO nova.compute.manager [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Took 6.94 seconds to build instance.
Dec 01 13:57:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e96d6a17-7195-4704-bd3f-c7f64d80a64d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.077s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'flavor' on Instance uuid 60ed46b9-cae1-4bd5-bd37-6fdada399023 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6903afc1-6e50-4e38-aeaf-3350b9316d46 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.868s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'pci_requests' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'numa_topology' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:36 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:57:36 user nova-compute[75288]: INFO nova.compute.claims [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Claim successful on node user
Dec 01 13:57:36 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:57:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:57:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.847s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:37 user nova-compute[75288]: INFO nova.network.neutron [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating port a4d06e3a-671b-493e-b9b8-4400f24f7877 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 13:57:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquired lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-b82096be-e33d-4e6a-bfa6-b7386afcc39b req-e354939d-232e-4e88-80ef-57c1e2b020b7 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-changed-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-b82096be-e33d-4e6a-bfa6-b7386afcc39b req-e354939d-232e-4e88-80ef-57c1e2b020b7 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Refreshing instance network info cache due to event network-changed-a4d06e3a-671b-493e-b9b8-4400f24f7877. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b82096be-e33d-4e6a-bfa6-b7386afcc39b req-e354939d-232e-4e88-80ef-57c1e2b020b7 service nova] Acquiring lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Releasing lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:57:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Creating image(s)
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'trusted_certs' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b82096be-e33d-4e6a-bfa6-b7386afcc39b req-e354939d-232e-4e88-80ef-57c1e2b020b7 service nova] Acquired lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG nova.network.neutron [req-b82096be-e33d-4e6a-bfa6-b7386afcc39b req-e354939d-232e-4e88-80ef-57c1e2b020b7 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Refreshing network info cache for port a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG nova.objects.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<d175885c-b192-4e34-b48c-33cd3809076e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "1322aba760fc4efc26e2684fb8bef1b99a2c7387" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "1322aba760fc4efc26e2684fb8bef1b99a2c7387" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-e9a1fcf4-e44c-41e2-85c6-727f396fa857 req-5ad54323-8fb2-4718-85e5-fe43ff81452c service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-changed-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-e9a1fcf4-e44c-41e2-85c6-727f396fa857 req-5ad54323-8fb2-4718-85e5-fe43ff81452c service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Refreshing instance network info cache due to event network-changed-d2e3b708-7d4a-4339-880a-bfe8801dadc0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9a1fcf4-e44c-41e2-85c6-727f396fa857 req-5ad54323-8fb2-4718-85e5-fe43ff81452c service nova] Acquiring lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9a1fcf4-e44c-41e2-85c6-727f396fa857 req-5ad54323-8fb2-4718-85e5-fe43ff81452c service nova] Acquired lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG nova.network.neutron [req-e9a1fcf4-e44c-41e2-85c6-727f396fa857 req-5ad54323-8fb2-4718-85e5-fe43ff81452c service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Refreshing network info cache for port d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:39 user nova-compute[75288]: INFO nova.compute.manager [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Detaching volume e55ba83a-624c-4d40-b278-7d922c7a11ef
Dec 01 13:57:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG nova.virt.images [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] c0828d29-3cf1-4e35-8214-592a362ee007 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:57:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387.part /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:40 user nova-compute[75288]: INFO nova.virt.block_device [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Attempting to driver detach volume e55ba83a-624c-4d40-b278-7d922c7a11ef from mountpoint /dev/vdb
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Attempting to detach device vdb from instance ce476b0b-4ed7-42bc-9801-860255953006 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:57:40 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:57:40 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:57:40 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:57:40 user nova-compute[75288]:   <serial>e55ba83a-624c-4d40-b278-7d922c7a11ef</serial>
Dec 01 13:57:40 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:57:40 user nova-compute[75288]: </disk>
Dec 01 13:57:40 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:57:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Successfully detached device vdb from instance ce476b0b-4ed7-42bc-9801-860255953006 from the persistent domain config.
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce476b0b-4ed7-42bc-9801-860255953006 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:57:40 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:57:40 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:57:40 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:57:40 user nova-compute[75288]:   <serial>e55ba83a-624c-4d40-b278-7d922c7a11ef</serial>
Dec 01 13:57:40 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:57:40 user nova-compute[75288]: </disk>
Dec 01 13:57:40 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387.part /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387.converted" returned: 0 in 0.479s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-e9a1fcf4-e44c-41e2-85c6-727f396fa857 req-5ad54323-8fb2-4718-85e5-fe43ff81452c service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updated VIF entry in instance network info cache for port d2e3b708-7d4a-4339-880a-bfe8801dadc0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-e9a1fcf4-e44c-41e2-85c6-727f396fa857 req-5ad54323-8fb2-4718-85e5-fe43ff81452c service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating instance_info_cache with network_info: [{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9a1fcf4-e44c-41e2-85c6-727f396fa857 req-5ad54323-8fb2-4718-85e5-fe43ff81452c service nova] Releasing lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "1322aba760fc4efc26e2684fb8bef1b99a2c7387" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.141s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-b82096be-e33d-4e6a-bfa6-b7386afcc39b req-e354939d-232e-4e88-80ef-57c1e2b020b7 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updated VIF entry in instance network info cache for port a4d06e3a-671b-493e-b9b8-4400f24f7877. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-b82096be-e33d-4e6a-bfa6-b7386afcc39b req-e354939d-232e-4e88-80ef-57c1e2b020b7 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b82096be-e33d-4e6a-bfa6-b7386afcc39b req-e354939d-232e-4e88-80ef-57c1e2b020b7 service nova] Releasing lock "refresh_cache-d175885c-b192-4e34-b48c-33cd3809076e" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-acd21ca7-9855-434a-ada4-2ee166f40046 req-69ea0ec9-f333-43e8-aad9-271421ed3056 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-changed-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-acd21ca7-9855-434a-ada4-2ee166f40046 req-69ea0ec9-f333-43e8-aad9-271421ed3056 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Refreshing instance network info cache due to event network-changed-d2e3b708-7d4a-4339-880a-bfe8801dadc0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acd21ca7-9855-434a-ada4-2ee166f40046 req-69ea0ec9-f333-43e8-aad9-271421ed3056 service nova] Acquiring lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acd21ca7-9855-434a-ada4-2ee166f40046 req-69ea0ec9-f333-43e8-aad9-271421ed3056 service nova] Acquired lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-acd21ca7-9855-434a-ada4-2ee166f40046 req-69ea0ec9-f333-43e8-aad9-271421ed3056 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Refreshing network info cache for port d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387 --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "1322aba760fc4efc26e2684fb8bef1b99a2c7387" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "1322aba760fc4efc26e2684fb8bef1b99a2c7387" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387 --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387,backing_fmt=raw /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387,backing_fmt=raw /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk 1073741824" returned: 0 in 0.057s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "1322aba760fc4efc26e2684fb8bef1b99a2c7387" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387 --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'migration_context' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG nova.objects.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<d175885c-b192-4e34-b48c-33cd3809076e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:57:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Rebasing disk image.
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-acd21ca7-9855-434a-ada4-2ee166f40046 req-69ea0ec9-f333-43e8-aad9-271421ed3056 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updated VIF entry in instance network info cache for port d2e3b708-7d4a-4339-880a-bfe8801dadc0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-acd21ca7-9855-434a-ada4-2ee166f40046 req-69ea0ec9-f333-43e8-aad9-271421ed3056 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating instance_info_cache with network_info: [{"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-acd21ca7-9855-434a-ada4-2ee166f40046 req-69ea0ec9-f333-43e8-aad9-271421ed3056 service nova] Releasing lock "refresh_cache-ce476b0b-4ed7-42bc-9801-860255953006" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a -F raw /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a -F raw /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk" returned: 0 in 2.273s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Ensure instance console log exists: /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Start _get_guest_xml network_info=[{"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b2c75ea425da73d5f56fa8861fbace2e',container_format='bare',created_at=2023-12-01T13:55:33Z,direct_url=<?>,disk_format='qcow2',id=c0828d29-3cf1-4e35-8214-592a362ee007,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-839517980-shelved',owner='d0ab4adede7a473d9b75844aa0d9da42',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T13:55:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '81638f7f-a61a-4198-b3f2-34ae9d2b7ed9', 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGXQmWfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd175885c-b192-4e34-b48c-33cd3809076e', 'attached_at': '', 'detached_at': '', 'volume_id': '8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a', 'serial': '8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:57:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:57:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b2c75ea425da73d5f56fa8861fbace2e',container_format='bare',created_at=2023-12-01T13:55:33Z,direct_url=<?>,disk_format='qcow2',id=c0828d29-3cf1-4e35-8214-592a362ee007,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-839517980-shelved',owner='d0ab4adede7a473d9b75844aa0d9da42',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T13:55:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'vcpu_model' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<d175885c-b192-4e34-b48c-33cd3809076e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGXQmWfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:57:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:57:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:57:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:57:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:57:43 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260" returned: 21 in 0.055s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be607731-4843-4747-80d2-0d1b75a46f20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:57:43 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8f307c-5c2e-454a-aa4f-f5eefe613ebb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a] added
Dec 01 13:57:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8308f198-824e-4d6b-bba2-70e9559710eb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d2e5c7-bb24-49b3-9835-527cb31fb7ce]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGXQmWfo {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qGXQmWfo" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f20a7a-5f87-43a5-95f0-f2b73a0627c1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qGXQmWfo'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[340ea799-a931-4569-926f-1eecf98db4a4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c55987d-5f6e-46af-a45d-3b4773cbeb1d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6724494b-6649-4680-b0dd-f344b832219f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a, portal: 172.16.0.220,3260]
Dec 01 13:57:44 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a, portal: 172.16.0.220,3260] successful.
Dec 01 13:57:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcf2c33-fd96-4a4d-a56e-7daae4c33824]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[61942ed3-896c-42f4-80e8-d7aa1ad33533]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:57:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:57:44 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:57:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f49f76e-2871-45dc-a578-85d79364c7e1]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGXQmWfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:57:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26136386332653766', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136386332653766', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T13:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839517980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839517980',id=30,image_ref='c0828d29-3cf1-4e35-8214-592a362ee007',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1302462361',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-1nhecb1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member',shelved_at='2023-12-01T13:55:37.586984',shelved_host='user',shelved_image_id='c0828d29-3cf1-4e35-8214-592a362ee007'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=d175885c-b192-4e34-b48c-33cd3809076e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'pci_devices' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.objects.base [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<d175885c-b192-4e34-b48c-33cd3809076e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:57:45 user nova-compute[75288]:   <uuid>d175885c-b192-4e34-b48c-33cd3809076e</uuid>
Dec 01 13:57:45 user nova-compute[75288]:   <name>instance-0000001e</name>
Dec 01 13:57:45 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:57:45 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:57:45 user nova-compute[75288]:   <metadata>
Dec 01 13:57:45 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:57:45 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:57:45 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-839517980</nova:name>
Dec 01 13:57:45 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:57:43</nova:creationTime>
Dec 01 13:57:45 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:57:45 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:57:45 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:57:45 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:57:45 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:57:45 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:57:45 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:57:45 user nova-compute[75288]:       <nova:owner>
Dec 01 13:57:45 user nova-compute[75288]:         <nova:user uuid="4d51f494066a46c1b7fe1ed789318010">tempest-AttachVolumeShelveTestJSON-548010779-project-member</nova:user>
Dec 01 13:57:45 user nova-compute[75288]:         <nova:project uuid="d0ab4adede7a473d9b75844aa0d9da42">tempest-AttachVolumeShelveTestJSON-548010779</nova:project>
Dec 01 13:57:45 user nova-compute[75288]:       </nova:owner>
Dec 01 13:57:45 user nova-compute[75288]:       <nova:root type="image" uuid="c0828d29-3cf1-4e35-8214-592a362ee007"/>
Dec 01 13:57:45 user nova-compute[75288]:       <nova:ports>
Dec 01 13:57:45 user nova-compute[75288]:         <nova:port uuid="a4d06e3a-671b-493e-b9b8-4400f24f7877">
Dec 01 13:57:45 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 13:57:45 user nova-compute[75288]:         </nova:port>
Dec 01 13:57:45 user nova-compute[75288]:       </nova:ports>
Dec 01 13:57:45 user nova-compute[75288]:     </nova:instance>
Dec 01 13:57:45 user nova-compute[75288]:   </metadata>
Dec 01 13:57:45 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:57:45 user nova-compute[75288]:     <system>
Dec 01 13:57:45 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:57:45 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:57:45 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:57:45 user nova-compute[75288]:       <entry name="serial">d175885c-b192-4e34-b48c-33cd3809076e</entry>
Dec 01 13:57:45 user nova-compute[75288]:       <entry name="uuid">d175885c-b192-4e34-b48c-33cd3809076e</entry>
Dec 01 13:57:45 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:57:45 user nova-compute[75288]:     </system>
Dec 01 13:57:45 user nova-compute[75288]:   </sysinfo>
Dec 01 13:57:45 user nova-compute[75288]:   <os>
Dec 01 13:57:45 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:57:45 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:57:45 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:57:45 user nova-compute[75288]:   </os>
Dec 01 13:57:45 user nova-compute[75288]:   <features>
Dec 01 13:57:45 user nova-compute[75288]:     <acpi/>
Dec 01 13:57:45 user nova-compute[75288]:     <apic/>
Dec 01 13:57:45 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:57:45 user nova-compute[75288]:   </features>
Dec 01 13:57:45 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:57:45 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:57:45 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:57:45 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:57:45 user nova-compute[75288]:   </clock>
Dec 01 13:57:45 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:57:45 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:57:45 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:57:45 user nova-compute[75288]:   </cpu>
Dec 01 13:57:45 user nova-compute[75288]:   <devices>
Dec 01 13:57:45 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:57:45 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:57:45 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk"/>
Dec 01 13:57:45 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:57:45 user nova-compute[75288]:     </disk>
Dec 01 13:57:45 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 13:57:45 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:57:45 user nova-compute[75288]:       <source dev="/dev/sdd"/>
Dec 01 13:57:45 user nova-compute[75288]:       <target dev="vdc" bus="virtio"/>
Dec 01 13:57:45 user nova-compute[75288]:       <serial>8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a</serial>
Dec 01 13:57:45 user nova-compute[75288]:     </disk>
Dec 01 13:57:45 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:57:45 user nova-compute[75288]:       <mac address="fa:16:3e:a8:39:41"/>
Dec 01 13:57:45 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:57:45 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:57:45 user nova-compute[75288]:       <target dev="tapa4d06e3a-67"/>
Dec 01 13:57:45 user nova-compute[75288]:     </interface>
Dec 01 13:57:45 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:57:45 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/console.log" append="off"/>
Dec 01 13:57:45 user nova-compute[75288]:     </serial>
Dec 01 13:57:45 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:57:45 user nova-compute[75288]:     <video>
Dec 01 13:57:45 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:57:45 user nova-compute[75288]:     </video>
Dec 01 13:57:45 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:57:45 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:57:45 user nova-compute[75288]:     </rng>
Dec 01 13:57:45 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:57:45 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:57:45 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:57:45 user nova-compute[75288]:     </memballoon>
Dec 01 13:57:45 user nova-compute[75288]:   </devices>
Dec 01 13:57:45 user nova-compute[75288]: </domain>
Dec 01 13:57:45 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T13:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839517980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839517980',id=30,image_ref='c0828d29-3cf1-4e35-8214-592a362ee007',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1302462361',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:53:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-1nhecb1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member',shelved_at='2023-12-01T13:55:37.586984',shelved_host='user',shelved_image_id='c0828d29-3cf1-4e35-8214-592a362ee007'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=d175885c-b192-4e34-b48c-33cd3809076e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG os_vif [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '767127d8-fd38-5bfb-9896-4e18d91c5527', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4d06e3a-67, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4d06e3a-67, col_values=(('qos', UUID('91311b0a-b537-4b0f-ab13-64e129d0eccc')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4d06e3a-67, col_values=(('external_ids', {'iface-id': 'a4d06e3a-671b-493e-b9b8-4400f24f7877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:39:41', 'vm-uuid': 'd175885c-b192-4e34-b48c-33cd3809076e'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:45 user nova-compute[75288]: INFO os_vif [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67')
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:57:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No VIF found with MAC fa:16:3e:a8:39:41, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e835b2b-3ed9-41d1-9a13-ae8dd0e1dc9b req-9e867dca-19f6-4671-b2a6-d3f0c871fe90 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e835b2b-3ed9-41d1-9a13-ae8dd0e1dc9b req-9e867dca-19f6-4671-b2a6-d3f0c871fe90 service nova] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e835b2b-3ed9-41d1-9a13-ae8dd0e1dc9b req-9e867dca-19f6-4671-b2a6-d3f0c871fe90 service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e835b2b-3ed9-41d1-9a13-ae8dd0e1dc9b req-9e867dca-19f6-4671-b2a6-d3f0c871fe90 service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e835b2b-3ed9-41d1-9a13-ae8dd0e1dc9b req-9e867dca-19f6-4671-b2a6-d3f0c871fe90 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] No waiting events found dispatching network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:57:47 user nova-compute[75288]: WARNING nova.compute.manager [req-8e835b2b-3ed9-41d1-9a13-ae8dd0e1dc9b req-9e867dca-19f6-4671-b2a6-d3f0c871fe90 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received unexpected event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 13:57:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-f97fdec9-6382-485c-bf18-3539a014c3b8 req-06328b47-a3f5-419e-aba2-ecd9106070b4 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:57:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f97fdec9-6382-485c-bf18-3539a014c3b8 req-06328b47-a3f5-419e-aba2-ecd9106070b4 service nova] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:57:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f97fdec9-6382-485c-bf18-3539a014c3b8 req-06328b47-a3f5-419e-aba2-ecd9106070b4 service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:57:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f97fdec9-6382-485c-bf18-3539a014c3b8 req-06328b47-a3f5-419e-aba2-ecd9106070b4 service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-f97fdec9-6382-485c-bf18-3539a014c3b8 req-06328b47-a3f5-419e-aba2-ecd9106070b4 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] No waiting events found dispatching network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:57:49 user nova-compute[75288]: WARNING nova.compute.manager [req-f97fdec9-6382-485c-bf18-3539a014c3b8 req-06328b47-a3f5-419e-aba2-ecd9106070b4 service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received unexpected event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 13:57:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:57:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:57:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance spawned successfully.
Dec 01 13:57:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:57:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4e70cdc7-92ae-4774-ac0b-78731ead4175 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.966s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:57:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:57:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:00 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce476b0b-4ed7-42bc-9801-860255953006 is timed out.
Dec 01 13:58:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Successfully detached device vdb from instance ce476b0b-4ed7-42bc-9801-860255953006 from the live domain config.
Dec 01 13:58:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aJGQLcSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:58:00 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4256493c-5fe0-4bee-926a-fcf74b6e1148]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:58:00 user nova-compute[75288]: No targets found.
Dec 01 13:58:00 user nova-compute[75288]: iSNS:
Dec 01 13:58:00 user nova-compute[75288]: No targets found.
Dec 01 13:58:00 user nova-compute[75288]: STATIC:
Dec 01 13:58:00 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef
Dec 01 13:58:00 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:58:00 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:58:00 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:58:00 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:58:00 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:58:00 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 13:58:00 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:58:00 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:58:00 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a
Dec 01 13:58:00 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:58:00 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:58:00 user nova-compute[75288]: FIRMWARE:
Dec 01 13:58:00 user nova-compute[75288]: No targets found.
Dec 01 13:58:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:58:00 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:58:00 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0a83b9-4927-4417-896b-4ae5e7ab6dc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d37a0f-1863-46e7-b4c7-290b179eb70c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:58:00 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:58:00 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:58:00 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:58:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:58:00 user nova-compute[75288]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef (non-flash)
Dec 01 13:58:00 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:58:00 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:58:00 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ee29e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.064s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[66740bbc-a415-4955-bf44-ab159aa01d8f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc9828-2342-4a42-9c6b-20fd404eca75]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdfbbb9-a263-48ed-b881-03fd8705af1a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b660ec-43aa-4cfd-b07c-493fdd0b4dab]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[357af461-f88a-4274-b813-7e894ba1d6bc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:58:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[194fa8cf-9b52-4c97-86de-adb85f8b7dfd]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef, portal: 172.16.0.220,3260]
Dec 01 13:58:01 user nova-compute[75288]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef, portal: 172.16.0.220,3260] successful.
Dec 01 13:58:01 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e55ba83a-624c-4d40-b278-7d922c7a11ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a388cd-23d4-44b1-a53b-9f4113a1e199]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] <== disconnect_volume: return (375ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'flavor' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:58:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0618a00-122b-42b6-b4e3-9370bb09016c tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.056s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:07 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:58:07 user nova-compute[75288]: INFO nova.compute.manager [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] instance snapshotting
Dec 01 13:58:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Beginning live snapshot process
Dec 01 13:58:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpag8bjssr/d0fe791daca9487889f4d7301be24ded.delta 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpag8bjssr/d0fe791daca9487889f4d7301be24ded.delta 1073741824" returned: 0 in 0.049s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 13:58:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:58:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:58:09 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 13:58:09 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:58:09 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpag8bjssr/d0fe791daca9487889f4d7301be24ded.delta /opt/stack/data/nova/instances/snapshots/tmpag8bjssr/d0fe791daca9487889f4d7301be24ded {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpag8bjssr/d0fe791daca9487889f4d7301be24ded.delta /opt/stack/data/nova/instances/snapshots/tmpag8bjssr/d0fe791daca9487889f4d7301be24ded" returned: 0 in 0.362s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Snapshot extracted, beginning image upload
Dec 01 13:58:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Snapshot image upload complete
Dec 01 13:58:12 user nova-compute[75288]: INFO nova.compute.manager [None req-cfc361f5-037f-4b1a-90c5-4003df4a0d5d tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Took 5.10 seconds to snapshot the instance on the hypervisor.
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 13:58:15 user nova-compute[75288]: INFO nova.compute.claims [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Claim successful on node user
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 13:58:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 13:58:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 13:58:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG nova.policy [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35b2de5a7fb5488ba4e0e6204e730a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '265995abf58f45f3bbcf9a9763b30f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 13:58:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Creating image(s)
Dec 01 13:58:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "/opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "/opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "/opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "093f1a9396a6e343c2812115aed30b027c6a6163" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "093f1a9396a6e343c2812115aed30b027c6a6163" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Successfully created port: c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 1.044s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG nova.virt.images [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] 2e8b0280-8a64-41d9-b674-ee1754e37f32 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163.part /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163.part /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163.converted" returned: 0 in 0.242s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "093f1a9396a6e343c2812115aed30b027c6a6163" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.661s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Successfully updated port: c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquired lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163 --force-share --output=json" returned: 0 in 0.211s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "093f1a9396a6e343c2812115aed30b027c6a6163" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "093f1a9396a6e343c2812115aed30b027c6a6163" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-dd752473-f88e-4162-9840-7d311fc59af6 req-5db00805-dd03-441d-8200-22b9899899cb service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-changed-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-dd752473-f88e-4162-9840-7d311fc59af6 req-5db00805-dd03-441d-8200-22b9899899cb service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Refreshing instance network info cache due to event network-changed-c36a4179-ca05-42e1-9722-5b6b0988dd40. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dd752473-f88e-4162-9840-7d311fc59af6 req-5db00805-dd03-441d-8200-22b9899899cb service nova] Acquiring lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163 --force-share --output=json" returned: 0 in 0.471s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163,backing_fmt=raw /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163,backing_fmt=raw /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk 1073741824" returned: 0 in 0.051s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "093f1a9396a6e343c2812115aed30b027c6a6163" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.527s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:58:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:58:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7351MB free_disk=24.962512969970703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163 --force-share --output=json" returned: 0 in 0.168s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Ensure instance console log exists: /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Applying migration context for instance b4211312-8a32-4723-801d-47c3db348668 as it has an incoming, in-progress migration 8c968267-54c3-4c6a-9015-6876a33f7b69. Migration status is finished {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 13:58:18 user nova-compute[75288]: INFO nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating resource usage from migration 8c968267-54c3-4c6a-9015-6876a33f7b69
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updating instance_info_cache with network_info: [{"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Releasing lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Instance network_info: |[{"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dd752473-f88e-4162-9840-7d311fc59af6 req-5db00805-dd03-441d-8200-22b9899899cb service nova] Acquired lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-dd752473-f88e-4162-9840-7d311fc59af6 req-5db00805-dd03-441d-8200-22b9899899cb service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Refreshing network info cache for port c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Start _get_guest_xml network_info=[{"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e9bf7bf5d9444779eeca5e2d53858bac',container_format='bare',created_at=2023-12-01T13:58:08Z,direct_url=<?>,disk_format='qcow2',id=2e8b0280-8a64-41d9-b674-ee1754e37f32,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1526506697',owner='265995abf58f45f3bbcf9a9763b30f7c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T13:58:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '2e8b0280-8a64-41d9-b674-ee1754e37f32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ce476b0b-4ed7-42bc-9801-860255953006 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Migration 8c968267-54c3-4c6a-9015-6876a33f7b69 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b4211312-8a32-4723-801d-47c3db348668 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d175885c-b192-4e34-b48c-33cd3809076e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:58:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:58:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e9bf7bf5d9444779eeca5e2d53858bac',container_format='bare',created_at=2023-12-01T13:58:08Z,direct_url=<?>,disk_format='qcow2',id=2e8b0280-8a64-41d9-b674-ee1754e37f32,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1526506697',owner='265995abf58f45f3bbcf9a9763b30f7c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T13:58:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-374442381',display_name='tempest-TestStampPattern-server-374442381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-374442381',id=36,image_ref='2e8b0280-8a64-41d9-b674-ee1754e37f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL+EHm/xpEHocK4PGywUkdMgPUm3PvVQCZAtgnyMweWmGc4EZJmIRhcUDceKjjDUHaGiGhpCbY1eWeuL2sbOcyDf9YOZ/RySTwVTw18QS5oHeN1VGNdG51gHPory5yiNw==',key_name='tempest-TestStampPattern-1491628277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265995abf58f45f3bbcf9a9763b30f7c',ramdisk_id='',reservation_id='r-nauepk1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60ed46b9-cae1-4bd5-bd37-6fdada399023',image_min_disk='1',image_min_ram='0',image_owner_id='265995abf58f45f3bbcf9a9763b30f7c',image_owner_project_name='tempest-TestStampPattern-1525886470',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1525886470-project-member',image_user_id='35b2de5a7fb5488ba4e0e6204e730a97',network_allocated='True',owner_project_name='tempest-TestStampPattern-1525886470',owner_user_name='tempest-TestStampPattern-1525886470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:58:16Z,user_data=None,user_id='35b2de5a7fb5488ba4e0e6204e730a97',uuid=5279904e-b465-44d4-a3b9-8e7b3bcac17a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converting VIF {"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=c36a4179-ca05-42e1-9722-5b6b0988dd40,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36a4179-ca') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'pci_devices' on Instance uuid 5279904e-b465-44d4-a3b9-8e7b3bcac17a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 13:58:18 user nova-compute[75288]:   <uuid>5279904e-b465-44d4-a3b9-8e7b3bcac17a</uuid>
Dec 01 13:58:18 user nova-compute[75288]:   <name>instance-00000024</name>
Dec 01 13:58:18 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 13:58:18 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 13:58:18 user nova-compute[75288]:   <metadata>
Dec 01 13:58:18 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 13:58:18 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 13:58:18 user nova-compute[75288]:       <nova:name>tempest-TestStampPattern-server-374442381</nova:name>
Dec 01 13:58:18 user nova-compute[75288]:       <nova:creationTime>2023-12-01 13:58:18</nova:creationTime>
Dec 01 13:58:18 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 13:58:18 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 13:58:18 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 13:58:18 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 13:58:18 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 13:58:18 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 13:58:18 user nova-compute[75288]:       </nova:flavor>
Dec 01 13:58:18 user nova-compute[75288]:       <nova:owner>
Dec 01 13:58:18 user nova-compute[75288]:         <nova:user uuid="35b2de5a7fb5488ba4e0e6204e730a97">tempest-TestStampPattern-1525886470-project-member</nova:user>
Dec 01 13:58:18 user nova-compute[75288]:         <nova:project uuid="265995abf58f45f3bbcf9a9763b30f7c">tempest-TestStampPattern-1525886470</nova:project>
Dec 01 13:58:18 user nova-compute[75288]:       </nova:owner>
Dec 01 13:58:18 user nova-compute[75288]:       <nova:root type="image" uuid="2e8b0280-8a64-41d9-b674-ee1754e37f32"/>
Dec 01 13:58:18 user nova-compute[75288]:       <nova:ports>
Dec 01 13:58:18 user nova-compute[75288]:         <nova:port uuid="c36a4179-ca05-42e1-9722-5b6b0988dd40">
Dec 01 13:58:18 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 13:58:18 user nova-compute[75288]:         </nova:port>
Dec 01 13:58:18 user nova-compute[75288]:       </nova:ports>
Dec 01 13:58:18 user nova-compute[75288]:     </nova:instance>
Dec 01 13:58:18 user nova-compute[75288]:   </metadata>
Dec 01 13:58:18 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 13:58:18 user nova-compute[75288]:     <system>
Dec 01 13:58:18 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 13:58:18 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 13:58:18 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 13:58:18 user nova-compute[75288]:       <entry name="serial">5279904e-b465-44d4-a3b9-8e7b3bcac17a</entry>
Dec 01 13:58:18 user nova-compute[75288]:       <entry name="uuid">5279904e-b465-44d4-a3b9-8e7b3bcac17a</entry>
Dec 01 13:58:18 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 13:58:18 user nova-compute[75288]:     </system>
Dec 01 13:58:18 user nova-compute[75288]:   </sysinfo>
Dec 01 13:58:18 user nova-compute[75288]:   <os>
Dec 01 13:58:18 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 13:58:18 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 13:58:18 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 13:58:18 user nova-compute[75288]:   </os>
Dec 01 13:58:18 user nova-compute[75288]:   <features>
Dec 01 13:58:18 user nova-compute[75288]:     <acpi/>
Dec 01 13:58:18 user nova-compute[75288]:     <apic/>
Dec 01 13:58:18 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 13:58:18 user nova-compute[75288]:   </features>
Dec 01 13:58:18 user nova-compute[75288]:   <clock offset="utc">
Dec 01 13:58:18 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 13:58:18 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 13:58:18 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 13:58:18 user nova-compute[75288]:   </clock>
Dec 01 13:58:18 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 13:58:18 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 13:58:18 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 13:58:18 user nova-compute[75288]:   </cpu>
Dec 01 13:58:18 user nova-compute[75288]:   <devices>
Dec 01 13:58:18 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 13:58:18 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 13:58:18 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk"/>
Dec 01 13:58:18 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 13:58:18 user nova-compute[75288]:     </disk>
Dec 01 13:58:18 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 13:58:18 user nova-compute[75288]:       <mac address="fa:16:3e:39:85:a8"/>
Dec 01 13:58:18 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:58:18 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 13:58:18 user nova-compute[75288]:       <target dev="tapc36a4179-ca"/>
Dec 01 13:58:18 user nova-compute[75288]:     </interface>
Dec 01 13:58:18 user nova-compute[75288]:     <serial type="pty">
Dec 01 13:58:18 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/console.log" append="off"/>
Dec 01 13:58:18 user nova-compute[75288]:     </serial>
Dec 01 13:58:18 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 13:58:18 user nova-compute[75288]:     <video>
Dec 01 13:58:18 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 13:58:18 user nova-compute[75288]:     </video>
Dec 01 13:58:18 user nova-compute[75288]:     <rng model="virtio">
Dec 01 13:58:18 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 13:58:18 user nova-compute[75288]:     </rng>
Dec 01 13:58:18 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 13:58:18 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 13:58:18 user nova-compute[75288]:       <stats period="10"/>
Dec 01 13:58:18 user nova-compute[75288]:     </memballoon>
Dec 01 13:58:18 user nova-compute[75288]:   </devices>
Dec 01 13:58:18 user nova-compute[75288]: </domain>
Dec 01 13:58:18 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-374442381',display_name='tempest-TestStampPattern-server-374442381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-374442381',id=36,image_ref='2e8b0280-8a64-41d9-b674-ee1754e37f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL+EHm/xpEHocK4PGywUkdMgPUm3PvVQCZAtgnyMweWmGc4EZJmIRhcUDceKjjDUHaGiGhpCbY1eWeuL2sbOcyDf9YOZ/RySTwVTw18QS5oHeN1VGNdG51gHPory5yiNw==',key_name='tempest-TestStampPattern-1491628277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='265995abf58f45f3bbcf9a9763b30f7c',ramdisk_id='',reservation_id='r-nauepk1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60ed46b9-cae1-4bd5-bd37-6fdada399023',image_min_disk='1',image_min_ram='0',image_owner_id='265995abf58f45f3bbcf9a9763b30f7c',image_owner_project_name='tempest-TestStampPattern-1525886470',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1525886470-project-member',image_user_id='35b2de5a7fb5488ba4e0e6204e730a97',network_allocated='True',owner_project_name='tempest-TestStampPattern-1525886470',owner_user_name='tempest-TestStampPattern-1525886470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T13:58:16Z,user_data=None,user_id='35b2de5a7fb5488ba4e0e6204e730a97',uuid=5279904e-b465-44d4-a3b9-8e7b3bcac17a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converting VIF {"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=c36a4179-ca05-42e1-9722-5b6b0988dd40,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36a4179-ca') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG os_vif [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=c36a4179-ca05-42e1-9722-5b6b0988dd40,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36a4179-ca') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15c6db9e-f556-5245-bbe9-b49fc4ac7564', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc36a4179-ca, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc36a4179-ca, col_values=(('qos', UUID('bbdc0e4c-c053-4684-a0a8-6de6e2852033')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc36a4179-ca, col_values=(('external_ids', {'iface-id': 'c36a4179-ca05-42e1-9722-5b6b0988dd40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:85:a8', 'vm-uuid': '5279904e-b465-44d4-a3b9-8e7b3bcac17a'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:18 user nova-compute[75288]: INFO os_vif [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=c36a4179-ca05-42e1-9722-5b6b0988dd40,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36a4179-ca')
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:58:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No VIF found with MAC fa:16:3e:39:85:a8, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:58:19 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:58:19 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:58:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-dd752473-f88e-4162-9840-7d311fc59af6 req-5db00805-dd03-441d-8200-22b9899899cb service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updated VIF entry in instance network info cache for port c36a4179-ca05-42e1-9722-5b6b0988dd40. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:58:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-dd752473-f88e-4162-9840-7d311fc59af6 req-5db00805-dd03-441d-8200-22b9899899cb service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updating instance_info_cache with network_info: [{"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:58:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-dd752473-f88e-4162-9840-7d311fc59af6 req-5db00805-dd03-441d-8200-22b9899899cb service nova] Releasing lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:58:19 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:58:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-c03d71a4-5559-4dfd-a617-548dc87eaf74 req-8a835e3b-d987-47bf-a12c-f2c11b563280 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c03d71a4-5559-4dfd-a617-548dc87eaf74 req-8a835e3b-d987-47bf-a12c-f2c11b563280 service nova] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c03d71a4-5559-4dfd-a617-548dc87eaf74 req-8a835e3b-d987-47bf-a12c-f2c11b563280 service nova] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c03d71a4-5559-4dfd-a617-548dc87eaf74 req-8a835e3b-d987-47bf-a12c-f2c11b563280 service nova] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-c03d71a4-5559-4dfd-a617-548dc87eaf74 req-8a835e3b-d987-47bf-a12c-f2c11b563280 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] No waiting events found dispatching network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:58:20 user nova-compute[75288]: WARNING nova.compute.manager [req-c03d71a4-5559-4dfd-a617-548dc87eaf74 req-8a835e3b-d987-47bf-a12c-f2c11b563280 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received unexpected event network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 for instance with vm_state building and task_state spawning.
Dec 01 13:58:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [{"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-57c16213-db78-4d88-8171-260254bc943a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:58:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 13:58:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Instance spawned successfully.
Dec 01 13:58:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 13:58:22 user nova-compute[75288]: INFO nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Took 6.25 seconds to spawn the instance on the hypervisor.
Dec 01 13:58:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:58:22 user nova-compute[75288]: INFO nova.compute.manager [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Took 7.38 seconds to build instance.
Dec 01 13:58:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-2de207f7-d91c-463f-9478-e0136324e1f5 req-cd369bce-658c-40c6-84f6-56dee296c9b6 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2de207f7-d91c-463f-9478-e0136324e1f5 req-cd369bce-658c-40c6-84f6-56dee296c9b6 service nova] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2de207f7-d91c-463f-9478-e0136324e1f5 req-cd369bce-658c-40c6-84f6-56dee296c9b6 service nova] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2de207f7-d91c-463f-9478-e0136324e1f5 req-cd369bce-658c-40c6-84f6-56dee296c9b6 service nova] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-2de207f7-d91c-463f-9478-e0136324e1f5 req-cd369bce-658c-40c6-84f6-56dee296c9b6 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] No waiting events found dispatching network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:58:22 user nova-compute[75288]: WARNING nova.compute.manager [req-2de207f7-d91c-463f-9478-e0136324e1f5 req-cd369bce-658c-40c6-84f6-56dee296c9b6 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received unexpected event network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 for instance with vm_state active and task_state None.
Dec 01 13:58:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5b06ebb5-df77-4196-97ee-e376e4cd1f7e tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.499s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Going to confirm migration 2 {{(pid=75288) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 01 13:58:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:58:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquired lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:58:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 13:58:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'info_cache' on Instance uuid b4211312-8a32-4723-801d-47c3db348668 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:58:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating instance_info_cache with network_info: [{"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Releasing lock "refresh_cache-b4211312-8a32-4723-801d-47c3db348668" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'migration_context' on Instance uuid b4211312-8a32-4723-801d-47c3db348668 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG nova.objects.base [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Object Instance<b4211312-8a32-4723-801d-47c3db348668> lazy-loaded attributes: info_cache,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:29 user nova-compute[75288]: INFO nova.compute.manager [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Terminating instance
Dec 01 13:58:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-e69327b5-ca5b-4fb8-bf45-68218bc41244 req-4af70d8e-a5ae-4bc3-b9a0-bce45e68404d service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e69327b5-ca5b-4fb8-bf45-68218bc41244 req-4af70d8e-a5ae-4bc3-b9a0-bce45e68404d service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e69327b5-ca5b-4fb8-bf45-68218bc41244 req-4af70d8e-a5ae-4bc3-b9a0-bce45e68404d service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e69327b5-ca5b-4fb8-bf45-68218bc41244 req-4af70d8e-a5ae-4bc3-b9a0-bce45e68404d service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-e69327b5-ca5b-4fb8-bf45-68218bc41244 req-4af70d8e-a5ae-4bc3-b9a0-bce45e68404d service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-e69327b5-ca5b-4fb8-bf45-68218bc41244 req-4af70d8e-a5ae-4bc3-b9a0-bce45e68404d service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-unplugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.716s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Instance destroyed successfully.
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'resources' on Instance uuid ce476b0b-4ed7-42bc-9801-860255953006 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:58:30 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Deleted allocation for migration 8c968267-54c3-4c6a-9015-6876a33f7b69
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-898293798',display_name='tempest-ServerRescueNegativeTestJSON-server-898293798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-898293798',id=26,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc+Zizx0KU4YIgWRQ6wHDhgCZOBALQjYZgThcvzgaIFKNJWrmPvHt6TgjzBkijrHh+TxA9UV8Hc5NU4XjlSUVtH/24/aJnonQPBZEjENsXJ+40B6nhvTSZl28U4GD/svg==',key_name='tempest-keypair-1111385212',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-7310x4vc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cad75165194843718ebc8b886ab3b6b7',uuid=ce476b0b-4ed7-42bc-9801-860255953006,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "address": "fa:16:3e:97:73:e6", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e3b708-7d", "ovs_interfaceid": "d2e3b708-7d4a-4339-880a-bfe8801dadc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=d2e3b708-7d4a-4339-880a-bfe8801dadc0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e3b708-7d') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG os_vif [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=d2e3b708-7d4a-4339-880a-bfe8801dadc0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e3b708-7d') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2e3b708-7d, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e45ed85-df8b-4273-ac87-163e1f7ac44a) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:58:30 user nova-compute[75288]: INFO os_vif [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:73:e6,bridge_name='br-int',has_traffic_filtering=True,id=d2e3b708-7d4a-4339-880a-bfe8801dadc0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e3b708-7d')
Dec 01 13:58:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Deleting instance files /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006_del
Dec 01 13:58:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Deletion of /opt/stack/data/nova/instances/ce476b0b-4ed7-42bc-9801-860255953006_del complete
Dec 01 13:58:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-45fda243-ecc2-4766-b3d8-dbef916a5247 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.111s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:30 user nova-compute[75288]: INFO nova.compute.manager [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 01 13:58:30 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:58:30 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:58:31 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:58:31 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Took 0.70 seconds to deallocate network for instance.
Dec 01 13:58:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-5237ae02-bdc3-494c-a801-54de607f50ab req-4c07ceee-17c8-46f1-a804-4c87b2c15875 service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-deleted-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:58:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:31 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:58:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:58:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:31 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Deleted allocations for instance ce476b0b-4ed7-42bc-9801-860255953006
Dec 01 13:58:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a8330536-0366-46b7-9c4a-9d87f1f12f50 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "ce476b0b-4ed7-42bc-9801-860255953006" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.243s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-ca57dca9-6c80-4868-ace5-c0ccd96ecb55 req-671cb985-1876-4f72-83b3-d9f5f2ea969e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:58:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca57dca9-6c80-4868-ace5-c0ccd96ecb55 req-671cb985-1876-4f72-83b3-d9f5f2ea969e service nova] Acquiring lock "ce476b0b-4ed7-42bc-9801-860255953006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:58:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca57dca9-6c80-4868-ace5-c0ccd96ecb55 req-671cb985-1876-4f72-83b3-d9f5f2ea969e service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:58:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca57dca9-6c80-4868-ace5-c0ccd96ecb55 req-671cb985-1876-4f72-83b3-d9f5f2ea969e service nova] Lock "ce476b0b-4ed7-42bc-9801-860255953006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:58:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-ca57dca9-6c80-4868-ace5-c0ccd96ecb55 req-671cb985-1876-4f72-83b3-d9f5f2ea969e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] No waiting events found dispatching network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:58:32 user nova-compute[75288]: WARNING nova.compute.manager [req-ca57dca9-6c80-4868-ace5-c0ccd96ecb55 req-671cb985-1876-4f72-83b3-d9f5f2ea969e service nova] [instance: ce476b0b-4ed7-42bc-9801-860255953006] Received unexpected event network-vif-plugged-d2e3b708-7d4a-4339-880a-bfe8801dadc0 for instance with vm_state deleted and task_state None.
Dec 01 13:58:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:58:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:04 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:59:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:59:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 13:59:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:59:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:59:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:59:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 13:59:15 user nova-compute[75288]: INFO nova.compute.manager [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] instance snapshotting
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Beginning live snapshot process
Dec 01 13:59:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:15 user nova-compute[75288]: INFO nova.compute.manager [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Detaching volume 8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json -f qcow2 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:15 user nova-compute[75288]: INFO nova.virt.block_device [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Attempting to driver detach volume 8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a from mountpoint /dev/vdc
Dec 01 13:59:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Attempting to detach device vdc from instance d175885c-b192-4e34-b48c-33cd3809076e from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:59:16 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:59:16 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:59:16 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Dec 01 13:59:16 user nova-compute[75288]:   <serial>8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a</serial>
Dec 01 13:59:16 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 13:59:16 user nova-compute[75288]: </disk>
Dec 01 13:59:16 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:59:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully detached device vdc from instance d175885c-b192-4e34-b48c-33cd3809076e from the persistent domain config.
Dec 01 13:59:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d175885c-b192-4e34-b48c-33cd3809076e from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:59:16 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:59:16 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 13:59:16 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Dec 01 13:59:16 user nova-compute[75288]:   <serial>8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a</serial>
Dec 01 13:59:16 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 13:59:16 user nova-compute[75288]: </disk>
Dec 01 13:59:16 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqdx8po5i/892aa28e85e3423289c368018d4bf99f.delta 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqdx8po5i/892aa28e85e3423289c368018d4bf99f.delta 1073741824" returned: 0 in 0.047s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 13:59:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:59:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7550MB free_disk=24.899417877197266GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75288) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 13:59:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqdx8po5i/892aa28e85e3423289c368018d4bf99f.delta /opt/stack/data/nova/instances/snapshots/tmpqdx8po5i/892aa28e85e3423289c368018d4bf99f {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-ea7058db-dd9a-4e17-b12f-841f25fff020 req-1f167093-8e94-4ec8-b6c4-d7719a3cf0ea service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received event network-changed-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.manager [req-ea7058db-dd9a-4e17-b12f-841f25fff020 req-1f167093-8e94-4ec8-b6c4-d7719a3cf0ea service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Refreshing instance network info cache due to event network-changed-c235bd4e-196b-47ad-902e-a5712bf7fbc7. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ea7058db-dd9a-4e17-b12f-841f25fff020 req-1f167093-8e94-4ec8-b6c4-d7719a3cf0ea service nova] Acquiring lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ea7058db-dd9a-4e17-b12f-841f25fff020 req-1f167093-8e94-4ec8-b6c4-d7719a3cf0ea service nova] Acquired lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.network.neutron [req-ea7058db-dd9a-4e17-b12f-841f25fff020 req-1f167093-8e94-4ec8-b6c4-d7719a3cf0ea service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Refreshing network info cache for port c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 97df1bf5-d682-435b-9b70-7252770a3d5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance aecbeec1-872e-48d9-beb1-cf520b587d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b4211312-8a32-4723-801d-47c3db348668 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance d175885c-b192-4e34-b48c-33cd3809076e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 13:59:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqdx8po5i/892aa28e85e3423289c368018d4bf99f.delta /opt/stack/data/nova/instances/snapshots/tmpqdx8po5i/892aa28e85e3423289c368018d4bf99f" returned: 0 in 0.362s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Snapshot extracted, beginning image upload
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'flavor' on Instance uuid f64339c5-e6e5-4dbb-812f-e16f2acdd03b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:59:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Ignoring supplied device name: /dev/vdb
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:18 user nova-compute[75288]: INFO nova.compute.manager [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Attaching volume 32b7b320-fa80-411e-8376-05f3e2d952c7 to /dev/vdb
Dec 01 13:59:18 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-ea7058db-dd9a-4e17-b12f-841f25fff020 req-1f167093-8e94-4ec8-b6c4-d7719a3cf0ea service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Updated VIF entry in instance network info cache for port c235bd4e-196b-47ad-902e-a5712bf7fbc7. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-ea7058db-dd9a-4e17-b12f-841f25fff020 req-1f167093-8e94-4ec8-b6c4-d7719a3cf0ea service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Updating instance_info_cache with network_info: [{"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG os_brick.utils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6637d60e-c623-459c-8b03-caf0e8eebf52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ea7058db-dd9a-4e17-b12f-841f25fff020 req-1f167093-8e94-4ec8-b6c4-d7719a3cf0ea service nova] Releasing lock "refresh_cache-f64339c5-e6e5-4dbb-812f-e16f2acdd03b" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b60d3-2253-4409-8df3-994517050f3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.829s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aabf675-5b0f-48d0-825a-81db84f5a04d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff6d42f-baa9-436a-ad55-6f99ba33e801]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 13:59:18 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 13:59:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9631dab-63a9-45e2-92a2-ada8864e6a6e]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG os_brick.utils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:59:18 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Updating existing volume attachment record: e4793861-77a3-4597-a58d-5890a8232106 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 13:59:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 13:59:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 13:59:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 13:59:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 13:59:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updating instance_info_cache with network_info: [{"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:59:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-97df1bf5-d682-435b-9b70-7252770a3d5a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 13:59:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 13:59:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Snapshot image upload complete
Dec 01 13:59:20 user nova-compute[75288]: INFO nova.compute.manager [None req-3fefe56c-719e-4f8a-bb73-fef6aeb62bef tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Took 5.30 seconds to snapshot the instance on the hypervisor.
Dec 01 13:59:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 13:59:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmluyetJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:59:27 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:59:27 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:59:27 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be60625-b55b-4a36-9344-ad641fbae97d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 13:59:27 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0420c574-95d9-4c9a-927b-5e61ed5d7d98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7] added
Dec 01 13:59:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0bc3c-4284-4d30-9c7e-d77cd0d81388]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[68328dbb-9c63-44a3-8478-f364d0fa96a0]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmluyetJ {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vmluyetJ" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b7610-c70a-4d2f-9ec3-14a69b9267d6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vmluyetJ'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[37596877-b237-43a8-8b75-bf1ef34560f9]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cc0497-5387-4bfb-89b0-da9bf729c308]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:59:27 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:59:27 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:59:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:59:27 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:59:27 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:59:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:59:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ad2dc1-223b-446f-83d9-e6e07f672b6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7, portal: 172.16.0.220,3260]
Dec 01 13:59:28 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7, portal: 172.16.0.220,3260] successful.
Dec 01 13:59:28 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da84d614-a65c-4bcf-9fa1-bba3884eff80]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bcf545-494d-4344-9d0e-b46f47bcf840]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:59:28 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:59:28 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:59:28 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)
Dec 01 13:59:28 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:59:28 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:59:28 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:59:28 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)
Dec 01 13:59:28 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7aa13f-9005-4efc-802d-80a063982856]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmluyetJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26362346265633033', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362346265633033', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'flavor' on Instance uuid f64339c5-e6e5-4dbb-812f-e16f2acdd03b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 13:59:29 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:59:29 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:59:29 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:59:29 user nova-compute[75288]:   <serial>32b7b320-fa80-411e-8376-05f3e2d952c7</serial>
Dec 01 13:59:29 user nova-compute[75288]: </disk>
Dec 01 13:59:29 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] No VIF found with MAC fa:16:3e:af:13:1b, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 13:59:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-03386dee-db5c-44f6-ab5e-fb025b5b9a0d tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.263s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:30 user nova-compute[75288]: INFO nova.compute.manager [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Terminating instance
Dec 01 13:59:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-a560517b-a8a2-48cb-ad5e-487e208f5c26 req-40f30354-97d7-4c98-ac2e-d3ea76faba71 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-unplugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a560517b-a8a2-48cb-ad5e-487e208f5c26 req-40f30354-97d7-4c98-ac2e-d3ea76faba71 service nova] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a560517b-a8a2-48cb-ad5e-487e208f5c26 req-40f30354-97d7-4c98-ac2e-d3ea76faba71 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a560517b-a8a2-48cb-ad5e-487e208f5c26 req-40f30354-97d7-4c98-ac2e-d3ea76faba71 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-a560517b-a8a2-48cb-ad5e-487e208f5c26 req-40f30354-97d7-4c98-ac2e-d3ea76faba71 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] No waiting events found dispatching network-vif-unplugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-a560517b-a8a2-48cb-ad5e-487e208f5c26 req-40f30354-97d7-4c98-ac2e-d3ea76faba71 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-unplugged-c2b41ea4-c8ed-404e-845c-38adea30e710 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Instance destroyed successfully.
Dec 01 13:59:30 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'resources' on Instance uuid 97df1bf5-d682-435b-9b70-7252770a3d5a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-799462005',display_name='tempest-ServerRescueNegativeTestJSON-server-799462005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-799462005',id=3,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-ymuw9f1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:45:09Z,user_data=None,user_id='cad75165194843718ebc8b886ab3b6b7',uuid=97df1bf5-d682-435b-9b70-7252770a3d5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "c2b41ea4-c8ed-404e-845c-38adea30e710", "address": "fa:16:3e:6e:5d:2a", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b41ea4-c8", "ovs_interfaceid": "c2b41ea4-c8ed-404e-845c-38adea30e710", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=c2b41ea4-c8ed-404e-845c-38adea30e710,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b41ea4-c8') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG os_vif [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=c2b41ea4-c8ed-404e-845c-38adea30e710,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b41ea4-c8') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2b41ea4-c8, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a7eb476-d48f-49d2-84dd-1a53a8e3d83d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:30 user nova-compute[75288]: INFO os_vif [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5d:2a,bridge_name='br-int',has_traffic_filtering=True,id=c2b41ea4-c8ed-404e-845c-38adea30e710,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b41ea4-c8')
Dec 01 13:59:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Deleting instance files /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a_del
Dec 01 13:59:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Deletion of /opt/stack/data/nova/instances/97df1bf5-d682-435b-9b70-7252770a3d5a_del complete
Dec 01 13:59:31 user nova-compute[75288]: INFO nova.compute.manager [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Took 1.00 seconds to destroy the instance on the hypervisor.
Dec 01 13:59:31 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:59:31 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Took 0.67 seconds to deallocate network for instance.
Dec 01 13:59:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-eea7dc7e-db82-4a73-b10f-4018a057b469 req-1cb1641f-38be-4037-8173-bd4d589826c3 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-deleted-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Refreshing inventories for resource provider 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Updating ProviderTree inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Refreshing aggregate associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 13:59:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Refreshing trait associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 13:59:32 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:59:32 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:59:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:32 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Deleted allocations for instance 97df1bf5-d682-435b-9b70-7252770a3d5a
Dec 01 13:59:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d570e4f-b36d-4b0a-b178-7644ad74f312 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-c2160991-53d5-445c-9dac-90ca7f1acfae req-831e7e91-f1d9-4e08-b75b-7b199cb58b25 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:59:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2160991-53d5-445c-9dac-90ca7f1acfae req-831e7e91-f1d9-4e08-b75b-7b199cb58b25 service nova] Acquiring lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2160991-53d5-445c-9dac-90ca7f1acfae req-831e7e91-f1d9-4e08-b75b-7b199cb58b25 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c2160991-53d5-445c-9dac-90ca7f1acfae req-831e7e91-f1d9-4e08-b75b-7b199cb58b25 service nova] Lock "97df1bf5-d682-435b-9b70-7252770a3d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-c2160991-53d5-445c-9dac-90ca7f1acfae req-831e7e91-f1d9-4e08-b75b-7b199cb58b25 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] No waiting events found dispatching network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:59:32 user nova-compute[75288]: WARNING nova.compute.manager [req-c2160991-53d5-445c-9dac-90ca7f1acfae req-831e7e91-f1d9-4e08-b75b-7b199cb58b25 service nova] [instance: 97df1bf5-d682-435b-9b70-7252770a3d5a] Received unexpected event network-vif-plugged-c2b41ea4-c8ed-404e-845c-38adea30e710 for instance with vm_state deleted and task_state None.
Dec 01 13:59:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 13:59:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 13:59:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 13:59:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance has had 3 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Dec 01 13:59:34 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Deletion of /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize failed
Dec 01 13:59:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d175885c-b192-4e34-b48c-33cd3809076e is timed out.
Dec 01 13:59:36 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully detached device vdc from instance d175885c-b192-4e34-b48c-33cd3809076e from the live domain config.
Dec 01 13:59:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qGXQmWfo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 13:59:36 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb598cc-c603-4f7a-bb51-6dd068a04fa4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 13:59:36 user nova-compute[75288]: No targets found.
Dec 01 13:59:36 user nova-compute[75288]: iSNS:
Dec 01 13:59:36 user nova-compute[75288]: No targets found.
Dec 01 13:59:36 user nova-compute[75288]: STATIC:
Dec 01 13:59:36 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 13:59:36 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:59:36 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:59:36 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 13:59:36 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:59:36 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:59:36 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a
Dec 01 13:59:36 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:59:36 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:59:36 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7
Dec 01 13:59:36 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 13:59:36 user nova-compute[75288]:                 Iface Name: default
Dec 01 13:59:36 user nova-compute[75288]: FIRMWARE:
Dec 01 13:59:36 user nova-compute[75288]: No targets found.
Dec 01 13:59:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 13:59:36 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 13:59:36 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e259bc9f-0144-4ac9-91ff-58f087fd6765]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6077578-672d-46a5-a10a-a431f453f346]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:59:36 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:59:36 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:59:36 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)
Dec 01 13:59:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 13:59:36 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 13:59:36 user nova-compute[75288]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a (non-flash)
Dec 01 13:59:36 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)
Dec 01 13:59:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98b11870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c19157-812f-4c26-9fc0-0ead8b643f69]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19671ba-7345-4462-a80e-4d36e421fa6d]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f15f161-0fcb-4090-b90f-5db8a7890ed1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[12db88fe-3bae-4349-8216-2df4662bccfe]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cb66fc-376d-40d0-87c7-052f8d1fcd71]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[548a91a2-ef41-40c2-8516-56c9c63d8489]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a, portal: 172.16.0.220,3260]
Dec 01 13:59:36 user nova-compute[75288]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a, portal: 172.16.0.220,3260] successful.
Dec 01 13:59:36 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b30ceea-e8a3-4e41-84ca-b54f5b90cd1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef5167e-bce2-4bc6-a44d-ff6e9af3bf1c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] <== disconnect_volume: return (331ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 13:59:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 13:59:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'flavor' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:59:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7bc04f23-9940-4b82-8649-8a1c771237cb tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.851s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "aecbeec1-872e-48d9-beb1-cf520b587d54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:40 user nova-compute[75288]: INFO nova.compute.manager [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Terminating instance
Dec 01 13:59:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd5deab5-3ab9-45db-85ea-f7c8c14f273d req-e0134e4e-966a-4470-badd-ab3a1140aac3 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received event network-vif-unplugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd5deab5-3ab9-45db-85ea-f7c8c14f273d req-e0134e4e-966a-4470-badd-ab3a1140aac3 service nova] Acquiring lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd5deab5-3ab9-45db-85ea-f7c8c14f273d req-e0134e4e-966a-4470-badd-ab3a1140aac3 service nova] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bd5deab5-3ab9-45db-85ea-f7c8c14f273d req-e0134e4e-966a-4470-badd-ab3a1140aac3 service nova] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd5deab5-3ab9-45db-85ea-f7c8c14f273d req-e0134e4e-966a-4470-badd-ab3a1140aac3 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] No waiting events found dispatching network-vif-unplugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-bd5deab5-3ab9-45db-85ea-f7c8c14f273d req-e0134e4e-966a-4470-badd-ab3a1140aac3 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received event network-vif-unplugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 13:59:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Instance destroyed successfully.
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lazy-loading 'resources' on Instance uuid aecbeec1-872e-48d9-beb1-cf520b587d54 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-431956080',display_name='tempest-ServersNegativeTestJSON-server-431956080',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-431956080',id=24,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:50:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d51003ff129d43df8b28f33bae48350c',ramdisk_id='',reservation_id='r-315z5rac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1610504678',owner_user_name='tempest-ServersNegativeTestJSON-1610504678-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:51:00Z,user_data=None,user_id='e299489ce6ea49ba9fd3bd83a44002c4',uuid=aecbeec1-872e-48d9-beb1-cf520b587d54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converting VIF {"id": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "address": "fa:16:3e:29:96:fc", "network": {"id": "86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-557208116-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d51003ff129d43df8b28f33bae48350c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d372dd0-22", "ovs_interfaceid": "8d372dd0-2288-4aa0-912c-e610b7a0df38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:96:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d372dd0-2288-4aa0-912c-e610b7a0df38,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d372dd0-22') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG os_vif [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:96:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d372dd0-2288-4aa0-912c-e610b7a0df38,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d372dd0-22') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d372dd0-22, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35c46479-e661-42aa-bb3a-4a8122a76c8d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:41 user nova-compute[75288]: INFO os_vif [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:96:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d372dd0-2288-4aa0-912c-e610b7a0df38,network=Network(86abb5c2-33fb-42a8-a80c-f0cfe6a81c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d372dd0-22')
Dec 01 13:59:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Deleting instance files /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54_del
Dec 01 13:59:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Deletion of /opt/stack/data/nova/instances/aecbeec1-872e-48d9-beb1-cf520b587d54_del complete
Dec 01 13:59:41 user nova-compute[75288]: INFO nova.compute.manager [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Took 0.71 seconds to destroy the instance on the hypervisor.
Dec 01 13:59:41 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 13:59:41 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 13:59:42 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:59:42 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Took 1.04 seconds to deallocate network for instance.
Dec 01 13:59:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-4639367b-e074-48c9-9f03-0b05d1812a51 req-39550b98-afc3-44a7-ade0-171127120df0 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received event network-vif-deleted-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:59:42 user nova-compute[75288]: INFO nova.compute.manager [req-4639367b-e074-48c9-9f03-0b05d1812a51 req-39550b98-afc3-44a7-ade0-171127120df0 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Neutron deleted interface 8d372dd0-2288-4aa0-912c-e610b7a0df38; detaching it from the instance and deleting it from the info cache
Dec 01 13:59:42 user nova-compute[75288]: DEBUG nova.network.neutron [req-4639367b-e074-48c9-9f03-0b05d1812a51 req-39550b98-afc3-44a7-ade0-171127120df0 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 13:59:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-4639367b-e074-48c9-9f03-0b05d1812a51 req-39550b98-afc3-44a7-ade0-171127120df0 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Detach interface failed, port_id=8d372dd0-2288-4aa0-912c-e610b7a0df38, reason: Instance aecbeec1-872e-48d9-beb1-cf520b587d54 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 13:59:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:42 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 13:59:42 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 13:59:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:43 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Deleted allocations for instance aecbeec1-872e-48d9-beb1-cf520b587d54
Dec 01 13:59:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7d7e943e-fa72-42a7-9be6-62584810595a tempest-ServersNegativeTestJSON-1610504678 tempest-ServersNegativeTestJSON-1610504678-project-member] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-bfb20ab8-dca3-4205-9d16-d4d1bbbf1f2d req-afe509cc-907d-4055-a852-ead112cb7102 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received event network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 13:59:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bfb20ab8-dca3-4205-9d16-d4d1bbbf1f2d req-afe509cc-907d-4055-a852-ead112cb7102 service nova] Acquiring lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bfb20ab8-dca3-4205-9d16-d4d1bbbf1f2d req-afe509cc-907d-4055-a852-ead112cb7102 service nova] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bfb20ab8-dca3-4205-9d16-d4d1bbbf1f2d req-afe509cc-907d-4055-a852-ead112cb7102 service nova] Lock "aecbeec1-872e-48d9-beb1-cf520b587d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 13:59:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-bfb20ab8-dca3-4205-9d16-d4d1bbbf1f2d req-afe509cc-907d-4055-a852-ead112cb7102 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] No waiting events found dispatching network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 13:59:43 user nova-compute[75288]: WARNING nova.compute.manager [req-bfb20ab8-dca3-4205-9d16-d4d1bbbf1f2d req-afe509cc-907d-4055-a852-ead112cb7102 service nova] [instance: aecbeec1-872e-48d9-beb1-cf520b587d54] Received unexpected event network-vif-plugged-8d372dd0-2288-4aa0-912c-e610b7a0df38 for instance with vm_state deleted and task_state None.
Dec 01 13:59:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 13:59:51 user nova-compute[75288]: INFO nova.compute.manager [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Detaching volume 32b7b320-fa80-411e-8376-05f3e2d952c7
Dec 01 13:59:51 user nova-compute[75288]: INFO nova.virt.block_device [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Attempting to driver detach volume 32b7b320-fa80-411e-8376-05f3e2d952c7 from mountpoint /dev/vdb
Dec 01 13:59:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Attempting to detach device vdb from instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:59:51 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:59:51 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:59:51 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:59:51 user nova-compute[75288]:   <serial>32b7b320-fa80-411e-8376-05f3e2d952c7</serial>
Dec 01 13:59:51 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:59:51 user nova-compute[75288]: </disk>
Dec 01 13:59:51 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:59:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Successfully detached device vdb from instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b from the persistent domain config.
Dec 01 13:59:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 13:59:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 13:59:51 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 13:59:51 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 13:59:51 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 13:59:51 user nova-compute[75288]:   <serial>32b7b320-fa80-411e-8376-05f3e2d952c7</serial>
Dec 01 13:59:51 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 13:59:51 user nova-compute[75288]: </disk>
Dec 01 13:59:51 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 13:59:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 13:59:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 13:59:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 13:59:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:06 user nova-compute[75288]: INFO nova.compute.manager [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Terminating instance
Dec 01 14:00:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf2b4896-76aa-4a06-8730-e21a371bf14b req-5086c29a-73a0-4c37-8e8d-6a0abf6a0ada service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-unplugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf2b4896-76aa-4a06-8730-e21a371bf14b req-5086c29a-73a0-4c37-8e8d-6a0abf6a0ada service nova] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf2b4896-76aa-4a06-8730-e21a371bf14b req-5086c29a-73a0-4c37-8e8d-6a0abf6a0ada service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-bf2b4896-76aa-4a06-8730-e21a371bf14b req-5086c29a-73a0-4c37-8e8d-6a0abf6a0ada service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf2b4896-76aa-4a06-8730-e21a371bf14b req-5086c29a-73a0-4c37-8e8d-6a0abf6a0ada service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] No waiting events found dispatching network-vif-unplugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf2b4896-76aa-4a06-8730-e21a371bf14b req-5086c29a-73a0-4c37-8e8d-6a0abf6a0ada service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-unplugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:00:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Instance destroyed successfully.
Dec 01 14:00:06 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'resources' on Instance uuid d175885c-b192-4e34-b48c-33cd3809076e {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T13:53:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-839517980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-839517980',id=30,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQjRBfwBrWv++1UyxHenT16L3KFq6cSakLqlfmoGCl+bZVIfzlkHjCfl3H+BqULca2NxH+oj7D7R0RHzmyXm6b4Z/EU4SiGeF/xATyhIZFOE6n8jfxD/M/LqDc9wbO0Dw==',key_name='tempest-keypair-1302462361',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:57:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-1nhecb1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=d175885c-b192-4e34-b48c-33cd3809076e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "address": "fa:16:3e:a8:39:41", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4d06e3a-67", "ovs_interfaceid": "a4d06e3a-671b-493e-b9b8-4400f24f7877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG os_vif [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4d06e3a-67, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91311b0a-b537-4b0f-ab13-64e129d0eccc) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:06 user nova-compute[75288]: INFO os_vif [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:39:41,bridge_name='br-int',has_traffic_filtering=True,id=a4d06e3a-671b-493e-b9b8-4400f24f7877,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4d06e3a-67')
Dec 01 14:00:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Deleting instance files /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e_del
Dec 01 14:00:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Deletion of /opt/stack/data/nova/instances/d175885c-b192-4e34-b48c-33cd3809076e_del complete
Dec 01 14:00:07 user nova-compute[75288]: INFO nova.compute.manager [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 01 14:00:07 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:07 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Took 0.70 seconds to deallocate network for instance.
Dec 01 14:00:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b95a475-f169-4c7b-b924-ed0b4cca15f5 req-54da78fa-6e7c-4564-8ddc-db3e937a308a service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-deleted-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:07 user nova-compute[75288]: INFO nova.compute.manager [req-6b95a475-f169-4c7b-b924-ed0b4cca15f5 req-54da78fa-6e7c-4564-8ddc-db3e937a308a service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Neutron deleted interface a4d06e3a-671b-493e-b9b8-4400f24f7877; detaching it from the instance and deleting it from the info cache
Dec 01 14:00:07 user nova-compute[75288]: DEBUG nova.network.neutron [req-6b95a475-f169-4c7b-b924-ed0b4cca15f5 req-54da78fa-6e7c-4564-8ddc-db3e937a308a service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b95a475-f169-4c7b-b924-ed0b4cca15f5 req-54da78fa-6e7c-4564-8ddc-db3e937a308a service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Detach interface failed, port_id=a4d06e3a-671b-493e-b9b8-4400f24f7877, reason: Instance d175885c-b192-4e34-b48c-33cd3809076e could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'flavor' on Instance uuid 5279904e-b465-44d4-a3b9-8e7b3bcac17a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:07 user nova-compute[75288]: INFO nova.compute.manager [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Attaching volume 2042ac87-5318-4e1e-bfe2-dd1416eece78 to /dev/vdb
Dec 01 14:00:08 user nova-compute[75288]: DEBUG os_brick.utils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3574e8cf-5267-4472-8bf3-7efd633757c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af8adc1-b5f6-449e-9227-7ccb6f0b6169]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b5d76-c0de-4f24-bca9-b58b08d06b22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccab8ab5-0166-485e-b692-0622cd690ce8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:00:08 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76a35ba-c53b-410d-9c55-2425468fe324]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG os_brick.utils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updating existing volume attachment record: 52566acd-b8c1-4cd5-be50-f1f5a908a4c8 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:00:08 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Deleted allocations for instance d175885c-b192-4e34-b48c-33cd3809076e
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b1b81dd6-8bb3-4e5d-884e-8f828ef3b1b9 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "d175885c-b192-4e34-b48c-33cd3809076e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] Acquiring lock "d175885c-b192-4e34-b48c-33cd3809076e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] Lock "d175885c-b192-4e34-b48c-33cd3809076e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] No waiting events found dispatching network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:08 user nova-compute[75288]: WARNING nova.compute.manager [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] [instance: d175885c-b192-4e34-b48c-33cd3809076e] Received unexpected event network-vif-plugged-a4d06e3a-671b-493e-b9b8-4400f24f7877 for instance with vm_state deleted and task_state None.
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-changed-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Refreshing instance network info cache due to event network-changed-c36a4179-ca05-42e1-9722-5b6b0988dd40. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] Acquiring lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] Acquired lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Refreshing network info cache for port c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updated VIF entry in instance network info cache for port c36a4179-ca05-42e1-9722-5b6b0988dd40. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updating instance_info_cache with network_info: [{"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0f374b7a-d9e3-4772-b06f-4bc56129e7d5 req-1a881dbc-bbc2-4867-8c29-2ea43089152c service nova] Releasing lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:00:11 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:00:12 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b is timed out.
Dec 01 14:00:12 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Successfully detached device vdb from instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b from the live domain config.
Dec 01 14:00:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmluyetJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:00:12 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[100fef15-54ae-45c1-8924-dfa9a7a43a69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:00:12 user nova-compute[75288]: No targets found.
Dec 01 14:00:12 user nova-compute[75288]: iSNS:
Dec 01 14:00:12 user nova-compute[75288]: No targets found.
Dec 01 14:00:12 user nova-compute[75288]: STATIC:
Dec 01 14:00:12 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:00:12 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:00:12 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:00:12 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 14:00:12 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:00:12 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:00:12 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7
Dec 01 14:00:12 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:00:12 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:00:12 user nova-compute[75288]: FIRMWARE:
Dec 01 14:00:12 user nova-compute[75288]: No targets found.
Dec 01 14:00:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:00:12 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:00:12 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e60645-a9cb-480f-88ec-71fd7267a34b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c415e51e-4b54-4521-822a-0eebfb875f9f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:12 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:12 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)
Dec 01 14:00:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:12 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:12 user nova-compute[75288]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 (non-flash)
Dec 01 14:00:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98dafd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a2c725-5e43-4e66-9b5e-ad3ef083d94a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03fbb4c-ce23-4a0c-a0b7-8937adf9041d]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92583b2-415c-4cbe-a549-dccae005172d]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[647ca7ee-cf10-4795-b453-c164925ce088]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8085e1d-a6ea-461f-8eee-7935a31ab65f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc96ba7-6af4-4dd3-a1ed-13724a36b407]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7, portal: 172.16.0.220,3260]
Dec 01 14:00:12 user nova-compute[75288]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7, portal: 172.16.0.220,3260] successful.
Dec 01 14:00:12 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[437b3d5f-9c1f-4e99-8bb0-2188815e0512]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] <== disconnect_volume: return (343ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:00:12 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'flavor' on Instance uuid f64339c5-e6e5-4dbb-812f-e16f2acdd03b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2ff01c98-02c3-4be0-845b-72b3a6629c48 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.684s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:13 user nova-compute[75288]: INFO nova.compute.manager [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Terminating instance
Dec 01 14:00:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-255bf2ab-b8a1-443b-bd7a-c8bfb61df30c req-7567368b-2ba6-44c0-a2c7-bbb1a31f50e1 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received event network-vif-unplugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-255bf2ab-b8a1-443b-bd7a-c8bfb61df30c req-7567368b-2ba6-44c0-a2c7-bbb1a31f50e1 service nova] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-255bf2ab-b8a1-443b-bd7a-c8bfb61df30c req-7567368b-2ba6-44c0-a2c7-bbb1a31f50e1 service nova] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-255bf2ab-b8a1-443b-bd7a-c8bfb61df30c req-7567368b-2ba6-44c0-a2c7-bbb1a31f50e1 service nova] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-255bf2ab-b8a1-443b-bd7a-c8bfb61df30c req-7567368b-2ba6-44c0-a2c7-bbb1a31f50e1 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] No waiting events found dispatching network-vif-unplugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-255bf2ab-b8a1-443b-bd7a-c8bfb61df30c req-7567368b-2ba6-44c0-a2c7-bbb1a31f50e1 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received event network-vif-unplugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Instance destroyed successfully.
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lazy-loading 'resources' on Instance uuid f64339c5-e6e5-4dbb-812f-e16f2acdd03b {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-633634409',display_name='tempest-VolumesSnapshotTestJSON-instance-633634409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-633634409',id=35,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgKL5em/ivjbwZMwym+Tr+x+AAFQ1pf7lOFalgLApmwrAMp8vsOWXa2i1lB1urZrzzkj4ZDOuG3NZrYho4oI1MQNiDcJlsqb55Isi+8zoYfpQL1kfy6BFuTW8Wy8dWZ6A==',key_name='tempest-keypair-1544437578',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:57:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab33b0750b8b4f199df0d6dfe6136a8b',ramdisk_id='',reservation_id='r-pvjht3yh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-383967549',owner_user_name='tempest-VolumesSnapshotTestJSON-383967549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e384ef4f5a36497d8e805cf7cc87f32e',uuid=f64339c5-e6e5-4dbb-812f-e16f2acdd03b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converting VIF {"id": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "address": "fa:16:3e:af:13:1b", "network": {"id": "924f8c6c-c081-4b2f-be3d-496e63f9e04d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1077815881-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab33b0750b8b4f199df0d6dfe6136a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc235bd4e-19", "ovs_interfaceid": "c235bd4e-196b-47ad-902e-a5712bf7fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=c235bd4e-196b-47ad-902e-a5712bf7fbc7,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc235bd4e-19') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_vif [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=c235bd4e-196b-47ad-902e-a5712bf7fbc7,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc235bd4e-19') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc235bd4e-19, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c700bb6f-d3ec-47bf-a63e-7f7ff0e310a3) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:14 user nova-compute[75288]: INFO os_vif [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=c235bd4e-196b-47ad-902e-a5712bf7fbc7,network=Network(924f8c6c-c081-4b2f-be3d-496e63f9e04d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc235bd4e-19')
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vmluyetJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:00:14 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[09079d2e-7457-433e-825e-11b36b9ca4d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:00:14 user nova-compute[75288]: No targets found.
Dec 01 14:00:14 user nova-compute[75288]: iSNS:
Dec 01 14:00:14 user nova-compute[75288]: No targets found.
Dec 01 14:00:14 user nova-compute[75288]: STATIC:
Dec 01 14:00:14 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:00:14 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:00:14 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:00:14 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 14:00:14 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:00:14 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:00:14 user nova-compute[75288]: FIRMWARE:
Dec 01 14:00:14 user nova-compute[75288]: No targets found.
Dec 01 14:00:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:00:14 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:00:14 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7b320-fa80-411e-8376-05f3e2d952c7', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2147c768-cde2-4519-9294-f5a579600fa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34191f0b-be27-4b6a-8366-2c455e8a6b02]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:14 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:14 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbdc220670>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] <== disconnect_volume: return (76ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:00:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Deleting instance files /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b_del
Dec 01 14:00:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Deletion of /opt/stack/data/nova/instances/f64339c5-e6e5-4dbb-812f-e16f2acdd03b_del complete
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:14 user nova-compute[75288]: INFO nova.compute.manager [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Took 1.05 seconds to destroy the instance on the hypervisor.
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:00:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b2e08b7-7382-409a-8157-a01c4c094450 req-db812838-3cb8-43bc-9a3c-83313a847403 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received event network-vif-deleted-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:15 user nova-compute[75288]: INFO nova.compute.manager [req-8b2e08b7-7382-409a-8157-a01c4c094450 req-db812838-3cb8-43bc-9a3c-83313a847403 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Neutron deleted interface c235bd4e-196b-47ad-902e-a5712bf7fbc7; detaching it from the instance and deleting it from the info cache
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-8b2e08b7-7382-409a-8157-a01c4c094450 req-db812838-3cb8-43bc-9a3c-83313a847403 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:00:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7957MB free_disk=24.932270050048828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:15 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Took 0.97 seconds to deallocate network for instance.
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b2e08b7-7382-409a-8157-a01c4c094450 req-db812838-3cb8-43bc-9a3c-83313a847403 service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Detach interface failed, port_id=c235bd4e-196b-47ad-902e-a5712bf7fbc7, reason: Instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:00:15 user nova-compute[75288]: WARNING nova.volume.cinder [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Attachment e4793861-77a3-4597-a58d-5890a8232106 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e4793861-77a3-4597-a58d-5890a8232106. (HTTP 404) (Request-ID: req-6f633706-cb49-429d-98b8-8cb0bf5a0213)
Dec 01 14:00:15 user nova-compute[75288]: INFO nova.compute.manager [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Took 0.03 seconds to detach 1 volumes for instance.
Dec 01 14:00:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 57c16213-db78-4d88-8171-260254bc943a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b4211312-8a32-4723-801d-47c3db348668 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:00:15 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-b9598df1-528b-40fb-bcf6-49d08d03c8dd req-1084bbe0-8e6f-4240-a163-3e6d5354febb service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received event network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9598df1-528b-40fb-bcf6-49d08d03c8dd req-1084bbe0-8e6f-4240-a163-3e6d5354febb service nova] Acquiring lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9598df1-528b-40fb-bcf6-49d08d03c8dd req-1084bbe0-8e6f-4240-a163-3e6d5354febb service nova] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b9598df1-528b-40fb-bcf6-49d08d03c8dd req-1084bbe0-8e6f-4240-a163-3e6d5354febb service nova] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-b9598df1-528b-40fb-bcf6-49d08d03c8dd req-1084bbe0-8e6f-4240-a163-3e6d5354febb service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] No waiting events found dispatching network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:16 user nova-compute[75288]: WARNING nova.compute.manager [req-b9598df1-528b-40fb-bcf6-49d08d03c8dd req-1084bbe0-8e6f-4240-a163-3e6d5354febb service nova] [instance: f64339c5-e6e5-4dbb-812f-e16f2acdd03b] Received unexpected event network-vif-plugged-c235bd4e-196b-47ad-902e-a5712bf7fbc7 for instance with vm_state deleted and task_state None.
Dec 01 14:00:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.353s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:00:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:16 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Deleted allocations for instance f64339c5-e6e5-4dbb-812f-e16f2acdd03b
Dec 01 14:00:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cf45a82-3baa-4b0d-9445-d8f52e146d66 tempest-VolumesSnapshotTestJSON-383967549 tempest-VolumesSnapshotTestJSON-383967549-project-member] Lock "f64339c5-e6e5-4dbb-812f-e16f2acdd03b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.912s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIOaKsCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:00:17 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:00:17 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:00:17 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d3caf2-5838-41ed-a9f4-2736b6705d62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:00:17 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[076c4a47-3c7d-439a-a51b-cf12314ae36a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78] added
Dec 01 14:00:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b024fb3e-4318-48c4-9b9c-ebe86028566c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b2306-2dd8-4053-bf77-d8d4217e4b78]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIOaKsCW {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIOaKsCW" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb43581e-fbf6-424d-b355-ed7def48b745]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIOaKsCW'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2a1a4f-aefc-45ee-9ad6-857fe20ec4fc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1357f76-b970-45cc-8724-425ccebc06a8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:17 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:17 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[77186c73-8d41-48ee-832b-e4b158326269]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78, portal: 172.16.0.220,3260]
Dec 01 14:00:17 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78, portal: 172.16.0.220,3260] successful.
Dec 01 14:00:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97110eb4-b27c-4bee-a3fd-2f28b93bc2ca]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd29eab-e15a-494c-a104-8ea125b3112e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:17 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:17 user nova-compute[75288]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 (non-flash)
Dec 01 14:00:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:17 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:17 user nova-compute[75288]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 (non-flash)
Dec 01 14:00:17 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d2532-313a-4e97-8eb9-673c81bb5d28]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIOaKsCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updating instance_info_cache with network_info: [{"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23564326564386362', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564326564386362', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'flavor' on Instance uuid 5279904e-b465-44d4-a3b9-8e7b3bcac17a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:00:18 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:00:18 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 14:00:18 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:00:18 user nova-compute[75288]:   <serial>2042ac87-5318-4e1e-bfe2-dd1416eece78</serial>
Dec 01 14:00:18 user nova-compute[75288]: </disk>
Dec 01 14:00:18 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:00:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] No VIF found with MAC fa:16:3e:39:85:a8, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:00:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2d289627-ddd6-4053-b0ce-66c264cb5c55 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.143s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:19 user nova-compute[75288]: INFO nova.compute.manager [None req-3d488fbb-dec5-4552-ad4d-57630793a146 tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Get console output
Dec 01 14:00:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:19 user nova-compute[75288]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 01 14:00:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "57c16213-db78-4d88-8171-260254bc943a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:20 user nova-compute[75288]: INFO nova.compute.manager [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Terminating instance
Dec 01 14:00:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-5dd34eca-8de7-4f49-b231-0401c383109f req-5bccaf93-8c1b-49ad-a62c-4a10b4215a32 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5dd34eca-8de7-4f49-b231-0401c383109f req-5bccaf93-8c1b-49ad-a62c-4a10b4215a32 service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5dd34eca-8de7-4f49-b231-0401c383109f req-5bccaf93-8c1b-49ad-a62c-4a10b4215a32 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5dd34eca-8de7-4f49-b231-0401c383109f req-5bccaf93-8c1b-49ad-a62c-4a10b4215a32 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-5dd34eca-8de7-4f49-b231-0401c383109f req-5bccaf93-8c1b-49ad-a62c-4a10b4215a32 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.compute.manager [req-5dd34eca-8de7-4f49-b231-0401c383109f req-5bccaf93-8c1b-49ad-a62c-4a10b4215a32 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-unplugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:21 user nova-compute[75288]: INFO nova.compute.manager [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Detaching volume 2042ac87-5318-4e1e-bfe2-dd1416eece78
Dec 01 14:00:21 user nova-compute[75288]: INFO nova.virt.block_device [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Attempting to driver detach volume 2042ac87-5318-4e1e-bfe2-dd1416eece78 from mountpoint /dev/vdb
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Attempting to detach device vdb from instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:00:21 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:00:21 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 14:00:21 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:00:21 user nova-compute[75288]:   <serial>2042ac87-5318-4e1e-bfe2-dd1416eece78</serial>
Dec 01 14:00:21 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:00:21 user nova-compute[75288]: </disk>
Dec 01 14:00:21 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:00:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Successfully detached device vdb from instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a from the persistent domain config.
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:00:21 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:00:21 user nova-compute[75288]:   <source dev="/dev/sdd"/>
Dec 01 14:00:21 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:00:21 user nova-compute[75288]:   <serial>2042ac87-5318-4e1e-bfe2-dd1416eece78</serial>
Dec 01 14:00:21 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:00:21 user nova-compute[75288]: </disk>
Dec 01 14:00:21 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:00:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] Instance destroyed successfully.
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lazy-loading 'resources' on Instance uuid 57c16213-db78-4d88-8171-260254bc943a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2015631158',display_name='tempest-ServerRescueNegativeTestJSON-server-2015631158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2015631158',id=2,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:48:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5854339bf9c4f3db4a3bf2c65ddc344',ramdisk_id='',reservation_id='r-pw09zhis',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1340015149',owner_user_name='tempest-ServerRescueNegativeTestJSON-1340015149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:54Z,user_data=None,user_id='cad75165194843718ebc8b886ab3b6b7',uuid=57c16213-db78-4d88-8171-260254bc943a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converting VIF {"id": "8805c728-e19f-4972-95cc-3873e12010d0", "address": "fa:16:3e:5c:3c:f3", "network": {"id": "dc02501a-d148-484b-9bc6-db389682cb5a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2086127367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5854339bf9c4f3db4a3bf2c65ddc344", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8805c728-e1", "ovs_interfaceid": "8805c728-e19f-4972-95cc-3873e12010d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:3c:f3,bridge_name='br-int',has_traffic_filtering=True,id=8805c728-e19f-4972-95cc-3873e12010d0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8805c728-e1') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG os_vif [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:3c:f3,bridge_name='br-int',has_traffic_filtering=True,id=8805c728-e19f-4972-95cc-3873e12010d0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8805c728-e1') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8805c728-e1, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c8db7a9-9ea1-4651-88e8-f8b420210df3) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:21 user nova-compute[75288]: INFO os_vif [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:3c:f3,bridge_name='br-int',has_traffic_filtering=True,id=8805c728-e19f-4972-95cc-3873e12010d0,network=Network(dc02501a-d148-484b-9bc6-db389682cb5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8805c728-e1')
Dec 01 14:00:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Deleting instance files /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a_del
Dec 01 14:00:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Deletion of /opt/stack/data/nova/instances/57c16213-db78-4d88-8171-260254bc943a_del complete
Dec 01 14:00:21 user nova-compute[75288]: INFO nova.compute.manager [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] [instance: 57c16213-db78-4d88-8171-260254bc943a] Took 1.15 seconds to destroy the instance on the hypervisor.
Dec 01 14:00:21 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:00:21 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:22 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 57c16213-db78-4d88-8171-260254bc943a] Took 0.44 seconds to deallocate network for instance.
Dec 01 14:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-17208213-8ac1-4fc6-96d5-78e59d554419 req-97bf9344-9956-4f92-8a3a-e519cf5dc6e6 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-deleted-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:22 user nova-compute[75288]: INFO nova.compute.manager [req-17208213-8ac1-4fc6-96d5-78e59d554419 req-97bf9344-9956-4f92-8a3a-e519cf5dc6e6 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Neutron deleted interface 8805c728-e19f-4972-95cc-3873e12010d0; detaching it from the instance and deleting it from the info cache
Dec 01 14:00:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-17208213-8ac1-4fc6-96d5-78e59d554419 req-97bf9344-9956-4f92-8a3a-e519cf5dc6e6 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-17208213-8ac1-4fc6-96d5-78e59d554419 req-97bf9344-9956-4f92-8a3a-e519cf5dc6e6 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Detach interface failed, port_id=8805c728-e19f-4972-95cc-3873e12010d0, reason: Instance 57c16213-db78-4d88-8171-260254bc943a could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:22 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Deleted allocations for instance 57c16213-db78-4d88-8171-260254bc943a
Dec 01 14:00:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a97a368d-699b-4102-b88e-39466036f1b4 tempest-ServerRescueNegativeTestJSON-1340015149 tempest-ServerRescueNegativeTestJSON-1340015149-project-member] Lock "57c16213-db78-4d88-8171-260254bc943a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-6af8e025-6a25-4dbf-91b1-e9beab332766 req-30c0ebc4-c286-44cf-b777-7d7fe86fb868 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6af8e025-6a25-4dbf-91b1-e9beab332766 req-30c0ebc4-c286-44cf-b777-7d7fe86fb868 service nova] Acquiring lock "57c16213-db78-4d88-8171-260254bc943a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6af8e025-6a25-4dbf-91b1-e9beab332766 req-30c0ebc4-c286-44cf-b777-7d7fe86fb868 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6af8e025-6a25-4dbf-91b1-e9beab332766 req-30c0ebc4-c286-44cf-b777-7d7fe86fb868 service nova] Lock "57c16213-db78-4d88-8171-260254bc943a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-6af8e025-6a25-4dbf-91b1-e9beab332766 req-30c0ebc4-c286-44cf-b777-7d7fe86fb868 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] No waiting events found dispatching network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:23 user nova-compute[75288]: WARNING nova.compute.manager [req-6af8e025-6a25-4dbf-91b1-e9beab332766 req-30c0ebc4-c286-44cf-b777-7d7fe86fb868 service nova] [instance: 57c16213-db78-4d88-8171-260254bc943a] Received unexpected event network-vif-plugged-8805c728-e19f-4972-95cc-3873e12010d0 for instance with vm_state deleted and task_state None.
Dec 01 14:00:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:00:23 user nova-compute[75288]: INFO nova.compute.claims [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Claim successful on node user
Dec 01 14:00:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:00:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:00:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:00:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:00:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:00:24 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:00:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:00:24 user nova-compute[75288]: DEBUG nova.policy [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69266afe5e404e259d679d7498f99faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6b677b10d14d63984895b4cfbdad4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:00:24 user nova-compute[75288]: INFO nova.virt.block_device [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Booting with volume-backed-image 5960f30f-79c5-4c7d-9bd0-41d5142b4539 at /dev/vda
Dec 01 14:00:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Successfully created port: 53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Successfully updated port: 53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquired lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-92c3f361-359e-467c-9e24-0821fd2b6262 req-4a55d557-5cba-4b1a-8e69-d87fa810658a service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-changed-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-92c3f361-359e-467c-9e24-0821fd2b6262 req-4a55d557-5cba-4b1a-8e69-d87fa810658a service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Refreshing instance network info cache due to event network-changed-53631e8a-d098-4366-9070-7a6c5e255f48. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92c3f361-359e-467c-9e24-0821fd2b6262 req-4a55d557-5cba-4b1a-8e69-d87fa810658a service nova] Acquiring lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Updating instance_info_cache with network_info: [{"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Releasing lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance network_info: |[{"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92c3f361-359e-467c-9e24-0821fd2b6262 req-4a55d557-5cba-4b1a-8e69-d87fa810658a service nova] Acquired lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-92c3f361-359e-467c-9e24-0821fd2b6262 req-4a55d557-5cba-4b1a-8e69-d87fa810658a service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Refreshing network info cache for port 53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-92c3f361-359e-467c-9e24-0821fd2b6262 req-4a55d557-5cba-4b1a-8e69-d87fa810658a service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Updated VIF entry in instance network info cache for port 53631e8a-d098-4366-9070-7a6c5e255f48. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG nova.network.neutron [req-92c3f361-359e-467c-9e24-0821fd2b6262 req-4a55d557-5cba-4b1a-8e69-d87fa810658a service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Updating instance_info_cache with network_info: [{"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-92c3f361-359e-467c-9e24-0821fd2b6262 req-4a55d557-5cba-4b1a-8e69-d87fa810658a service nova] Releasing lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:00:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:00:28 user nova-compute[75288]: WARNING nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Dec 01 14:00:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 03de2627-2167-48c9-94cb-bd57c18f87c8 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 876c78f2-a975-49ea-9f97-cdca86cc1c51 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid b4211312-8a32-4723-801d-47c3db348668 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 60ed46b9-cae1-4bd5-bd37-6fdada399023 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 8a0ae420-3d13-48e9-88fa-432b97c27a28 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 5279904e-b465-44d4-a3b9-8e7b3bcac17a {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "b4211312-8a32-4723-801d-47c3db348668" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "b4211312-8a32-4723-801d-47c3db348668" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:00:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:00:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:00:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG os_brick.utils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f99abfd-878a-49b3-b2e4-d8e44ad44491]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0709e957-83a9-4e22-89f8-9d476121de86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5821870-8d8d-4ff0-a4c1-d8f4ebe20a39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29bc2c8-564e-4900-b072-d9bdbdf434a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:00:34 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:00:34 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa097bc-e417-45bc-bbce-528eebdedb90]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:00:34 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:00:35 user nova-compute[75288]: DEBUG os_brick.utils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:00:35 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Updating existing volume attachment record: abdeed6c-72ae-439d-bb76-b10367520316 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:00:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a is timed out.
Dec 01 14:00:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Successfully detached device vdb from instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a from the live domain config.
Dec 01 14:00:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIOaKsCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:00:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a69585-cc6b-4d90-868a-ef470d856e3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:00:41 user nova-compute[75288]: No targets found.
Dec 01 14:00:41 user nova-compute[75288]: iSNS:
Dec 01 14:00:41 user nova-compute[75288]: No targets found.
Dec 01 14:00:41 user nova-compute[75288]: STATIC:
Dec 01 14:00:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78
Dec 01 14:00:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:00:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:00:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:00:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:00:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:00:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 14:00:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:00:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:00:41 user nova-compute[75288]: FIRMWARE:
Dec 01 14:00:41 user nova-compute[75288]: No targets found.
Dec 01 14:00:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:00:41 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:00:41 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[627ef65e-ca8d-4547-a53b-3828ec261ed2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c14b65-2554-4e3e-ab41-b04890b80bda]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:41 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:41 user nova-compute[75288]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 (non-flash)
Dec 01 14:00:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:41 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:41 user nova-compute[75288]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 (non-flash)
Dec 01 14:00:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ed2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76730e6-bfed-4299-99c5-019606dea083]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6806dfb-0ba0-411d-ad16-c417c80aea95]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7170e06-6070-4d45-805d-0042308d2b19]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6968024-d7c6-49ab-910c-283dd89658d4]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ee689-5f7c-4be5-86a8-0292d7c15d25]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[febeb3a8-09df-45e3-a8c4-db5f58e7f381]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78, portal: 172.16.0.220,3260]
Dec 01 14:00:42 user nova-compute[75288]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78, portal: 172.16.0.220,3260] successful.
Dec 01 14:00:42 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2042ac87-5318-4e1e-bfe2-dd1416eece78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49b1898-9a92-4ef0-8cf1-d0e281f9d8b2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] <== disconnect_volume: return (305ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'flavor' on Instance uuid 5279904e-b465-44d4-a3b9-8e7b3bcac17a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f0fa35d3-af6f-4580-80f7-8de5f3217ceb tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.886s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.394s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:00:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Creating image(s)
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Ensure instance console log exists: /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Start _get_guest_xml network_info=[{"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'abdeed6c-72ae-439d-bb76-b10367520316', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buMekcFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28c7d2bd-7c14-4dbd-a798-48eb6546c51c', 'attached_at': '', 'detached_at': '', 'volume_id': '501208d1-fba1-41f1-87e1-d71db7cfed34', 'serial': '501208d1-fba1-41f1-87e1-d71db7cfed34'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:00:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:00:44 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buMekcFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:00:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:00:44 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:00:44 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[305798c3-6933-4eb3-9255-49c8267b0148]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:00:44 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c46a7-8d4d-4bc2-8b50-bba14bd074db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34] added
Dec 01 14:00:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f587c42e-41c1-45d2-bdf9-df9298de9510]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a9a47e-23ce-4c4d-bfa0-792d3f194993]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buMekcFr {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buMekcFr" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8e8dcb-7dca-451a-9080-a9543a6e28ce]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'buMekcFr'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c1701e-3c2f-4508-a97e-b91fbb531e58]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[277495f8-c6d3-4f59-9f18-a9299ff66fc6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:44 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:44 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf8a340-4850-4586-802a-83bee594b9a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34, portal: 172.16.0.220,3260]
Dec 01 14:00:44 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34, portal: 172.16.0.220,3260] successful.
Dec 01 14:00:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[75674ec6-5bec-4673-a708-1bd237736b13]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda0eb93-97c7-49de-a755-7c32364a3ac5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:45 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:45 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:00:45 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:00:45 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:00:45 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:00:45 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c4d44-84e9-4d0a-a8a5-52d907391097]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:00:45 user nova-compute[75288]: INFO nova.compute.claims [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Claim successful on node user
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:00:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.policy [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce70853828047c2a95d82b34f79cc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d43be7c75dc4274801b9860ded7693d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:00:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Creating image(s)
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buMekcFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23230623162393038', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230623162393038', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-249953189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-249953189',id=37,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-jcvt2cdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:00:24Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=28c7d2bd-7c14-4dbd-a798-48eb6546c51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:5e:04,bridge_name='br-int',has_traffic_filtering=True,id=53631e8a-d098-4366-9070-7a6c5e255f48,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53631e8a-d0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'pci_devices' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:00:46 user nova-compute[75288]:   <uuid>28c7d2bd-7c14-4dbd-a798-48eb6546c51c</uuid>
Dec 01 14:00:46 user nova-compute[75288]:   <name>instance-00000025</name>
Dec 01 14:00:46 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:00:46 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:00:46 user nova-compute[75288]:   <metadata>
Dec 01 14:00:46 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:00:46 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:00:46 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-249953189</nova:name>
Dec 01 14:00:46 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:00:44</nova:creationTime>
Dec 01 14:00:46 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:00:46 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:00:46 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:00:46 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:00:46 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:00:46 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:00:46 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:00:46 user nova-compute[75288]:       <nova:owner>
Dec 01 14:00:46 user nova-compute[75288]:         <nova:user uuid="69266afe5e404e259d679d7498f99faa">tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member</nova:user>
Dec 01 14:00:46 user nova-compute[75288]:         <nova:project uuid="2e6b677b10d14d63984895b4cfbdad4b">tempest-ServerBootFromVolumeStableRescueTest-64531845</nova:project>
Dec 01 14:00:46 user nova-compute[75288]:       </nova:owner>
Dec 01 14:00:46 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:00:46 user nova-compute[75288]:       <nova:ports>
Dec 01 14:00:46 user nova-compute[75288]:         <nova:port uuid="53631e8a-d098-4366-9070-7a6c5e255f48">
Dec 01 14:00:46 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 14:00:46 user nova-compute[75288]:         </nova:port>
Dec 01 14:00:46 user nova-compute[75288]:       </nova:ports>
Dec 01 14:00:46 user nova-compute[75288]:     </nova:instance>
Dec 01 14:00:46 user nova-compute[75288]:   </metadata>
Dec 01 14:00:46 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:00:46 user nova-compute[75288]:     <system>
Dec 01 14:00:46 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:00:46 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:00:46 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:00:46 user nova-compute[75288]:       <entry name="serial">28c7d2bd-7c14-4dbd-a798-48eb6546c51c</entry>
Dec 01 14:00:46 user nova-compute[75288]:       <entry name="uuid">28c7d2bd-7c14-4dbd-a798-48eb6546c51c</entry>
Dec 01 14:00:46 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:00:46 user nova-compute[75288]:     </system>
Dec 01 14:00:46 user nova-compute[75288]:   </sysinfo>
Dec 01 14:00:46 user nova-compute[75288]:   <os>
Dec 01 14:00:46 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:00:46 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:00:46 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:00:46 user nova-compute[75288]:   </os>
Dec 01 14:00:46 user nova-compute[75288]:   <features>
Dec 01 14:00:46 user nova-compute[75288]:     <acpi/>
Dec 01 14:00:46 user nova-compute[75288]:     <apic/>
Dec 01 14:00:46 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:00:46 user nova-compute[75288]:   </features>
Dec 01 14:00:46 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:00:46 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:00:46 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:00:46 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:00:46 user nova-compute[75288]:   </clock>
Dec 01 14:00:46 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:00:46 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:00:46 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:00:46 user nova-compute[75288]:   </cpu>
Dec 01 14:00:46 user nova-compute[75288]:   <devices>
Dec 01 14:00:46 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 14:00:46 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:00:46 user nova-compute[75288]:       <source dev="/dev/sdd"/>
Dec 01 14:00:46 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:00:46 user nova-compute[75288]:       <serial>501208d1-fba1-41f1-87e1-d71db7cfed34</serial>
Dec 01 14:00:46 user nova-compute[75288]:     </disk>
Dec 01 14:00:46 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:00:46 user nova-compute[75288]:       <mac address="fa:16:3e:7a:5e:04"/>
Dec 01 14:00:46 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:00:46 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:00:46 user nova-compute[75288]:       <target dev="tap53631e8a-d0"/>
Dec 01 14:00:46 user nova-compute[75288]:     </interface>
Dec 01 14:00:46 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:00:46 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/console.log" append="off"/>
Dec 01 14:00:46 user nova-compute[75288]:     </serial>
Dec 01 14:00:46 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:00:46 user nova-compute[75288]:     <video>
Dec 01 14:00:46 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:00:46 user nova-compute[75288]:     </video>
Dec 01 14:00:46 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:00:46 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:00:46 user nova-compute[75288]:     </rng>
Dec 01 14:00:46 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:00:46 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:00:46 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:00:46 user nova-compute[75288]:     </memballoon>
Dec 01 14:00:46 user nova-compute[75288]:   </devices>
Dec 01 14:00:46 user nova-compute[75288]: </domain>
Dec 01 14:00:46 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-249953189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-249953189',id=37,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-jcvt2cdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:00:24Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=28c7d2bd-7c14-4dbd-a798-48eb6546c51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:5e:04,bridge_name='br-int',has_traffic_filtering=True,id=53631e8a-d098-4366-9070-7a6c5e255f48,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53631e8a-d0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG os_vif [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:5e:04,bridge_name='br-int',has_traffic_filtering=True,id=53631e8a-d098-4366-9070-7a6c5e255f48,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53631e8a-d0') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab8679d0-1d18-5e56-ae2a-55386273fa87', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53631e8a-d0, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53631e8a-d0, col_values=(('qos', UUID('400a4137-456d-4a19-ae71-f15d53c9cc34')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53631e8a-d0, col_values=(('external_ids', {'iface-id': '53631e8a-d098-4366-9070-7a6c5e255f48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:5e:04', 'vm-uuid': '28c7d2bd-7c14-4dbd-a798-48eb6546c51c'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:46 user nova-compute[75288]: INFO os_vif [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:5e:04,bridge_name='br-int',has_traffic_filtering=True,id=53631e8a-d098-4366-9070-7a6c5e255f48,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53631e8a-d0')
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No VIF found with MAC fa:16:3e:7a:5e:04, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk 1073741824" returned: 0 in 0.056s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Successfully created port: ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Cannot resize image /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Ensure instance console log exists: /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Successfully updated port: ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquired lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-d80e0e62-ac6c-41da-baa5-db0b7c5b097f req-dcafa110-8687-4c6e-a7a7-679e78ef9b2f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-changed-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-d80e0e62-ac6c-41da-baa5-db0b7c5b097f req-dcafa110-8687-4c6e-a7a7-679e78ef9b2f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Refreshing instance network info cache due to event network-changed-ef8189f5-33cb-4afa-9d8b-2890e86c9e28. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d80e0e62-ac6c-41da-baa5-db0b7c5b097f req-dcafa110-8687-4c6e-a7a7-679e78ef9b2f service nova] Acquiring lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Releasing lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance network_info: |[{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d80e0e62-ac6c-41da-baa5-db0b7c5b097f req-dcafa110-8687-4c6e-a7a7-679e78ef9b2f service nova] Acquired lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-d80e0e62-ac6c-41da-baa5-db0b7c5b097f req-dcafa110-8687-4c6e-a7a7-679e78ef9b2f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Refreshing network info cache for port ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Start _get_guest_xml network_info=[{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:00:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:00:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'pci_devices' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-8c6ec6d2-effe-4985-ad6e-1c8575d4731e req-a18c5413-3d52-4185-b70b-f39d99602388 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8c6ec6d2-effe-4985-ad6e-1c8575d4731e req-a18c5413-3d52-4185-b70b-f39d99602388 service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8c6ec6d2-effe-4985-ad6e-1c8575d4731e req-a18c5413-3d52-4185-b70b-f39d99602388 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8c6ec6d2-effe-4985-ad6e-1c8575d4731e req-a18c5413-3d52-4185-b70b-f39d99602388 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-8c6ec6d2-effe-4985-ad6e-1c8575d4731e req-a18c5413-3d52-4185-b70b-f39d99602388 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:47 user nova-compute[75288]: WARNING nova.compute.manager [req-8c6ec6d2-effe-4985-ad6e-1c8575d4731e req-a18c5413-3d52-4185-b70b-f39d99602388 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state building and task_state spawning.
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:00:47 user nova-compute[75288]:   <uuid>ba42382c-6649-4dd3-8ef6-aee0f151fda3</uuid>
Dec 01 14:00:47 user nova-compute[75288]:   <name>instance-00000026</name>
Dec 01 14:00:47 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:00:47 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:00:47 user nova-compute[75288]:   <metadata>
Dec 01 14:00:47 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:00:47 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:00:47 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeTestJSON-server-1282332462</nova:name>
Dec 01 14:00:47 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:00:47</nova:creationTime>
Dec 01 14:00:47 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:00:47 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:00:47 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:00:47 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:00:47 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:00:47 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:00:47 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:00:47 user nova-compute[75288]:       <nova:owner>
Dec 01 14:00:47 user nova-compute[75288]:         <nova:user uuid="9ce70853828047c2a95d82b34f79cc96">tempest-AttachVolumeTestJSON-800128847-project-member</nova:user>
Dec 01 14:00:47 user nova-compute[75288]:         <nova:project uuid="1d43be7c75dc4274801b9860ded7693d">tempest-AttachVolumeTestJSON-800128847</nova:project>
Dec 01 14:00:47 user nova-compute[75288]:       </nova:owner>
Dec 01 14:00:47 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:00:47 user nova-compute[75288]:       <nova:ports>
Dec 01 14:00:47 user nova-compute[75288]:         <nova:port uuid="ef8189f5-33cb-4afa-9d8b-2890e86c9e28">
Dec 01 14:00:47 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 14:00:47 user nova-compute[75288]:         </nova:port>
Dec 01 14:00:47 user nova-compute[75288]:       </nova:ports>
Dec 01 14:00:47 user nova-compute[75288]:     </nova:instance>
Dec 01 14:00:47 user nova-compute[75288]:   </metadata>
Dec 01 14:00:47 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:00:47 user nova-compute[75288]:     <system>
Dec 01 14:00:47 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:00:47 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:00:47 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:00:47 user nova-compute[75288]:       <entry name="serial">ba42382c-6649-4dd3-8ef6-aee0f151fda3</entry>
Dec 01 14:00:47 user nova-compute[75288]:       <entry name="uuid">ba42382c-6649-4dd3-8ef6-aee0f151fda3</entry>
Dec 01 14:00:47 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:00:47 user nova-compute[75288]:     </system>
Dec 01 14:00:47 user nova-compute[75288]:   </sysinfo>
Dec 01 14:00:47 user nova-compute[75288]:   <os>
Dec 01 14:00:47 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:00:47 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:00:47 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:00:47 user nova-compute[75288]:   </os>
Dec 01 14:00:47 user nova-compute[75288]:   <features>
Dec 01 14:00:47 user nova-compute[75288]:     <acpi/>
Dec 01 14:00:47 user nova-compute[75288]:     <apic/>
Dec 01 14:00:47 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:00:47 user nova-compute[75288]:   </features>
Dec 01 14:00:47 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:00:47 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:00:47 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:00:47 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:00:47 user nova-compute[75288]:   </clock>
Dec 01 14:00:47 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:00:47 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:00:47 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:00:47 user nova-compute[75288]:   </cpu>
Dec 01 14:00:47 user nova-compute[75288]:   <devices>
Dec 01 14:00:47 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:00:47 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:00:47 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk"/>
Dec 01 14:00:47 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:00:47 user nova-compute[75288]:     </disk>
Dec 01 14:00:47 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:00:47 user nova-compute[75288]:       <mac address="fa:16:3e:18:bf:e4"/>
Dec 01 14:00:47 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:00:47 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:00:47 user nova-compute[75288]:       <target dev="tapef8189f5-33"/>
Dec 01 14:00:47 user nova-compute[75288]:     </interface>
Dec 01 14:00:47 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:00:47 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/console.log" append="off"/>
Dec 01 14:00:47 user nova-compute[75288]:     </serial>
Dec 01 14:00:47 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:00:47 user nova-compute[75288]:     <video>
Dec 01 14:00:47 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:00:47 user nova-compute[75288]:     </video>
Dec 01 14:00:47 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:00:47 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:00:47 user nova-compute[75288]:     </rng>
Dec 01 14:00:47 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:00:47 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:00:47 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:00:47 user nova-compute[75288]:     </memballoon>
Dec 01 14:00:47 user nova-compute[75288]:   </devices>
Dec 01 14:00:47 user nova-compute[75288]: </domain>
Dec 01 14:00:47 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG os_vif [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fdf3614-d2b0-5080-bf87-e397cd38d26d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef8189f5-33, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef8189f5-33, col_values=(('qos', UUID('1632f29d-d7d4-4d1d-a902-063073f4513f')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef8189f5-33, col_values=(('external_ids', {'iface-id': 'ef8189f5-33cb-4afa-9d8b-2890e86c9e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:bf:e4', 'vm-uuid': 'ba42382c-6649-4dd3-8ef6-aee0f151fda3'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:47 user nova-compute[75288]: INFO os_vif [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33')
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:00:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No VIF found with MAC fa:16:3e:18:bf:e4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:00:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-d80e0e62-ac6c-41da-baa5-db0b7c5b097f req-dcafa110-8687-4c6e-a7a7-679e78ef9b2f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updated VIF entry in instance network info cache for port ef8189f5-33cb-4afa-9d8b-2890e86c9e28. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:00:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-d80e0e62-ac6c-41da-baa5-db0b7c5b097f req-dcafa110-8687-4c6e-a7a7-679e78ef9b2f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:00:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d80e0e62-ac6c-41da-baa5-db0b7c5b097f req-dcafa110-8687-4c6e-a7a7-679e78ef9b2f service nova] Releasing lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-404e42df-ff89-44c0-8685-f30607cabaab req-d431c7f1-c846-4261-9eba-f94df8d4e70f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-404e42df-ff89-44c0-8685-f30607cabaab req-d431c7f1-c846-4261-9eba-f94df8d4e70f service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-404e42df-ff89-44c0-8685-f30607cabaab req-d431c7f1-c846-4261-9eba-f94df8d4e70f service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-404e42df-ff89-44c0-8685-f30607cabaab req-d431c7f1-c846-4261-9eba-f94df8d4e70f service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-404e42df-ff89-44c0-8685-f30607cabaab req-d431c7f1-c846-4261-9eba-f94df8d4e70f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:49 user nova-compute[75288]: WARNING nova.compute.manager [req-404e42df-ff89-44c0-8685-f30607cabaab req-d431c7f1-c846-4261-9eba-f94df8d4e70f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state building and task_state spawning.
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:00:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance spawned successfully.
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a02be3c-f3cb-4f85-9443-1ea3dbe71fed req-4184f0f6-b384-435f-bbc2-672ceac27b27 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a02be3c-f3cb-4f85-9443-1ea3dbe71fed req-4184f0f6-b384-435f-bbc2-672ceac27b27 service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a02be3c-f3cb-4f85-9443-1ea3dbe71fed req-4184f0f6-b384-435f-bbc2-672ceac27b27 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a02be3c-f3cb-4f85-9443-1ea3dbe71fed req-4184f0f6-b384-435f-bbc2-672ceac27b27 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a02be3c-f3cb-4f85-9443-1ea3dbe71fed req-4184f0f6-b384-435f-bbc2-672ceac27b27 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:49 user nova-compute[75288]: WARNING nova.compute.manager [req-2a02be3c-f3cb-4f85-9443-1ea3dbe71fed req-4184f0f6-b384-435f-bbc2-672ceac27b27 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state building and task_state spawning.
Dec 01 14:00:49 user nova-compute[75288]: INFO nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Took 5.32 seconds to spawn the instance on the hypervisor.
Dec 01 14:00:49 user nova-compute[75288]: DEBUG nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:00:50 user nova-compute[75288]: INFO nova.compute.manager [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Took 26.32 seconds to build instance.
Dec 01 14:00:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-64af08f1-71eb-473d-8076-d1f0bfe69d57 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.448s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 21.516s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:50 user nova-compute[75288]: INFO nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Dec 01 14:00:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-5623d3c8-6f50-42b8-90c7-0de539aa6fc1 req-f00fdf97-6414-45ea-bcc7-176fb664edcb service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5623d3c8-6f50-42b8-90c7-0de539aa6fc1 req-f00fdf97-6414-45ea-bcc7-176fb664edcb service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5623d3c8-6f50-42b8-90c7-0de539aa6fc1 req-f00fdf97-6414-45ea-bcc7-176fb664edcb service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5623d3c8-6f50-42b8-90c7-0de539aa6fc1 req-f00fdf97-6414-45ea-bcc7-176fb664edcb service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-5623d3c8-6f50-42b8-90c7-0de539aa6fc1 req-f00fdf97-6414-45ea-bcc7-176fb664edcb service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:00:51 user nova-compute[75288]: WARNING nova.compute.manager [req-5623d3c8-6f50-42b8-90c7-0de539aa6fc1 req-f00fdf97-6414-45ea-bcc7-176fb664edcb service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state building and task_state spawning.
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:00:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance spawned successfully.
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:00:51 user nova-compute[75288]: INFO nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Took 6.05 seconds to spawn the instance on the hypervisor.
Dec 01 14:00:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:00:52 user nova-compute[75288]: INFO nova.compute.manager [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Took 6.95 seconds to build instance.
Dec 01 14:00:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b83ff39d-18b4-42eb-97e4-972c0386812a tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.088s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:00:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:00:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:00:59 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:00:59 user nova-compute[75288]: INFO nova.compute.claims [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Claim successful on node user
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:01:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.policy [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d51f494066a46c1b7fe1ed789318010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ab4adede7a473d9b75844aa0d9da42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:01:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Creating image(s)
Dec 01 14:01:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk 1073741824" returned: 0 in 0.066s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Successfully created port: 84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.225s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Cannot resize image /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Ensure instance console log exists: /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Successfully updated port: 84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquired lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-94139950-7fae-4885-8c22-f67959eb211a req-c14fed03-fb2b-4b6d-af54-b54a414f8d9d service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-changed-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-94139950-7fae-4885-8c22-f67959eb211a req-c14fed03-fb2b-4b6d-af54-b54a414f8d9d service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Refreshing instance network info cache due to event network-changed-84c070b9-aa68-466b-adc9-dc6f190937a2. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-94139950-7fae-4885-8c22-f67959eb211a req-c14fed03-fb2b-4b6d-af54-b54a414f8d9d service nova] Acquiring lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating instance_info_cache with network_info: [{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Releasing lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance network_info: |[{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-94139950-7fae-4885-8c22-f67959eb211a req-c14fed03-fb2b-4b6d-af54-b54a414f8d9d service nova] Acquired lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-94139950-7fae-4885-8c22-f67959eb211a req-c14fed03-fb2b-4b6d-af54-b54a414f8d9d service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Refreshing network info cache for port 84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Start _get_guest_xml network_info=[{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:01:02 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:01:02 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2061549974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2061549974',id=39,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLGZoVn8wo0j+HxWvdZGonHfTRdvBPEtxiw/UmPhkHaSaiKgn4cKu/pEbtMUPTDSXF0UFybWDDxrt/bhvYTH/kmRQDBt0bxFDQBvzI3cxxc/MM2LRFwALn05z402ouZnQ==',key_name='tempest-keypair-1949436941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-5toak1n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=9ae651bf-c461-46e1-bc89-182740d6fe04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:01:02 user nova-compute[75288]:   <uuid>9ae651bf-c461-46e1-bc89-182740d6fe04</uuid>
Dec 01 14:01:02 user nova-compute[75288]:   <name>instance-00000027</name>
Dec 01 14:01:02 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:01:02 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:01:02 user nova-compute[75288]:   <metadata>
Dec 01 14:01:02 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:01:02 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:01:02 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2061549974</nova:name>
Dec 01 14:01:02 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:01:02</nova:creationTime>
Dec 01 14:01:02 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:01:02 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:01:02 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:01:02 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:01:02 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:01:02 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:01:02 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:01:02 user nova-compute[75288]:       <nova:owner>
Dec 01 14:01:02 user nova-compute[75288]:         <nova:user uuid="4d51f494066a46c1b7fe1ed789318010">tempest-AttachVolumeShelveTestJSON-548010779-project-member</nova:user>
Dec 01 14:01:02 user nova-compute[75288]:         <nova:project uuid="d0ab4adede7a473d9b75844aa0d9da42">tempest-AttachVolumeShelveTestJSON-548010779</nova:project>
Dec 01 14:01:02 user nova-compute[75288]:       </nova:owner>
Dec 01 14:01:02 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:01:02 user nova-compute[75288]:       <nova:ports>
Dec 01 14:01:02 user nova-compute[75288]:         <nova:port uuid="84c070b9-aa68-466b-adc9-dc6f190937a2">
Dec 01 14:01:02 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 14:01:02 user nova-compute[75288]:         </nova:port>
Dec 01 14:01:02 user nova-compute[75288]:       </nova:ports>
Dec 01 14:01:02 user nova-compute[75288]:     </nova:instance>
Dec 01 14:01:02 user nova-compute[75288]:   </metadata>
Dec 01 14:01:02 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:01:02 user nova-compute[75288]:     <system>
Dec 01 14:01:02 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:01:02 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:01:02 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:01:02 user nova-compute[75288]:       <entry name="serial">9ae651bf-c461-46e1-bc89-182740d6fe04</entry>
Dec 01 14:01:02 user nova-compute[75288]:       <entry name="uuid">9ae651bf-c461-46e1-bc89-182740d6fe04</entry>
Dec 01 14:01:02 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:01:02 user nova-compute[75288]:     </system>
Dec 01 14:01:02 user nova-compute[75288]:   </sysinfo>
Dec 01 14:01:02 user nova-compute[75288]:   <os>
Dec 01 14:01:02 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:01:02 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:01:02 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:01:02 user nova-compute[75288]:   </os>
Dec 01 14:01:02 user nova-compute[75288]:   <features>
Dec 01 14:01:02 user nova-compute[75288]:     <acpi/>
Dec 01 14:01:02 user nova-compute[75288]:     <apic/>
Dec 01 14:01:02 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:01:02 user nova-compute[75288]:   </features>
Dec 01 14:01:02 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:01:02 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:01:02 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:01:02 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:01:02 user nova-compute[75288]:   </clock>
Dec 01 14:01:02 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:01:02 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:01:02 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:01:02 user nova-compute[75288]:   </cpu>
Dec 01 14:01:02 user nova-compute[75288]:   <devices>
Dec 01 14:01:02 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:01:02 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:01:02 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk"/>
Dec 01 14:01:02 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:01:02 user nova-compute[75288]:     </disk>
Dec 01 14:01:02 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:01:02 user nova-compute[75288]:       <mac address="fa:16:3e:c5:3b:b7"/>
Dec 01 14:01:02 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:01:02 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:01:02 user nova-compute[75288]:       <target dev="tap84c070b9-aa"/>
Dec 01 14:01:02 user nova-compute[75288]:     </interface>
Dec 01 14:01:02 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:01:02 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/console.log" append="off"/>
Dec 01 14:01:02 user nova-compute[75288]:     </serial>
Dec 01 14:01:02 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:01:02 user nova-compute[75288]:     <video>
Dec 01 14:01:02 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:01:02 user nova-compute[75288]:     </video>
Dec 01 14:01:02 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:01:02 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:01:02 user nova-compute[75288]:     </rng>
Dec 01 14:01:02 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:01:02 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:01:02 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:01:02 user nova-compute[75288]:     </memballoon>
Dec 01 14:01:02 user nova-compute[75288]:   </devices>
Dec 01 14:01:02 user nova-compute[75288]: </domain>
Dec 01 14:01:02 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2061549974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2061549974',id=39,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLGZoVn8wo0j+HxWvdZGonHfTRdvBPEtxiw/UmPhkHaSaiKgn4cKu/pEbtMUPTDSXF0UFybWDDxrt/bhvYTH/kmRQDBt0bxFDQBvzI3cxxc/MM2LRFwALn05z402ouZnQ==',key_name='tempest-keypair-1949436941',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-5toak1n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=9ae651bf-c461-46e1-bc89-182740d6fe04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG os_vif [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16b06a50-fef6-535b-acb3-25c867f80e2c', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c070b9-aa, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c070b9-aa, col_values=(('qos', UUID('4534f16d-cf43-43c8-931f-b95c8f7527f4')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c070b9-aa, col_values=(('external_ids', {'iface-id': '84c070b9-aa68-466b-adc9-dc6f190937a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:3b:b7', 'vm-uuid': '9ae651bf-c461-46e1-bc89-182740d6fe04'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:02 user nova-compute[75288]: INFO os_vif [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa')
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No VIF found with MAC fa:16:3e:c5:3b:b7, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-94139950-7fae-4885-8c22-f67959eb211a req-c14fed03-fb2b-4b6d-af54-b54a414f8d9d service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updated VIF entry in instance network info cache for port 84c070b9-aa68-466b-adc9-dc6f190937a2. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG nova.network.neutron [req-94139950-7fae-4885-8c22-f67959eb211a req-c14fed03-fb2b-4b6d-af54-b54a414f8d9d service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating instance_info_cache with network_info: [{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:01:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-94139950-7fae-4885-8c22-f67959eb211a req-c14fed03-fb2b-4b6d-af54-b54a414f8d9d service nova] Releasing lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:01:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-e42fed2c-7923-452d-8b9a-140f1144ea8a req-52a71574-cf28-47d2-b2cd-c7431607989a service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e42fed2c-7923-452d-8b9a-140f1144ea8a req-52a71574-cf28-47d2-b2cd-c7431607989a service nova] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e42fed2c-7923-452d-8b9a-140f1144ea8a req-52a71574-cf28-47d2-b2cd-c7431607989a service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e42fed2c-7923-452d-8b9a-140f1144ea8a req-52a71574-cf28-47d2-b2cd-c7431607989a service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-e42fed2c-7923-452d-8b9a-140f1144ea8a req-52a71574-cf28-47d2-b2cd-c7431607989a service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] No waiting events found dispatching network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:01:04 user nova-compute[75288]: WARNING nova.compute.manager [req-e42fed2c-7923-452d-8b9a-140f1144ea8a req-52a71574-cf28-47d2-b2cd-c7431607989a service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received unexpected event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 for instance with vm_state building and task_state spawning.
Dec 01 14:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:01:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance spawned successfully.
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-6bd2f6f3-91b0-40a5-a93b-65fc954ec1b9 req-ce1f0f2f-be55-40ce-8001-7b6629b0e709 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6bd2f6f3-91b0-40a5-a93b-65fc954ec1b9 req-ce1f0f2f-be55-40ce-8001-7b6629b0e709 service nova] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6bd2f6f3-91b0-40a5-a93b-65fc954ec1b9 req-ce1f0f2f-be55-40ce-8001-7b6629b0e709 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6bd2f6f3-91b0-40a5-a93b-65fc954ec1b9 req-ce1f0f2f-be55-40ce-8001-7b6629b0e709 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-6bd2f6f3-91b0-40a5-a93b-65fc954ec1b9 req-ce1f0f2f-be55-40ce-8001-7b6629b0e709 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] No waiting events found dispatching network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:01:06 user nova-compute[75288]: WARNING nova.compute.manager [req-6bd2f6f3-91b0-40a5-a93b-65fc954ec1b9 req-ce1f0f2f-be55-40ce-8001-7b6629b0e709 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received unexpected event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 for instance with vm_state building and task_state spawning.
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:01:06 user nova-compute[75288]: INFO nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Took 5.60 seconds to spawn the instance on the hypervisor.
Dec 01 14:01:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:01:06 user nova-compute[75288]: INFO nova.compute.manager [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Took 6.58 seconds to build instance.
Dec 01 14:01:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5cff9d06-0f9a-428e-ac3a-5c1c443ddef2 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.703s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b51a260-36f9-468e-b2e1-6f3571806f83 req-4e40271d-0c83-4649-9ce2-c67fd0268101 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-changed-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:11 user nova-compute[75288]: DEBUG nova.compute.manager [req-8b51a260-36f9-468e-b2e1-6f3571806f83 req-4e40271d-0c83-4649-9ce2-c67fd0268101 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Refreshing instance network info cache due to event network-changed-c36a4179-ca05-42e1-9722-5b6b0988dd40. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:01:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b51a260-36f9-468e-b2e1-6f3571806f83 req-4e40271d-0c83-4649-9ce2-c67fd0268101 service nova] Acquiring lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:01:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b51a260-36f9-468e-b2e1-6f3571806f83 req-4e40271d-0c83-4649-9ce2-c67fd0268101 service nova] Acquired lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:01:11 user nova-compute[75288]: DEBUG nova.network.neutron [req-8b51a260-36f9-468e-b2e1-6f3571806f83 req-4e40271d-0c83-4649-9ce2-c67fd0268101 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Refreshing network info cache for port c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:12 user nova-compute[75288]: INFO nova.compute.manager [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Terminating instance
Dec 01 14:01:12 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-a3e716bf-0fdc-4d19-96f2-58389d8f7737 req-315c3e2d-d9f0-4b7b-8f9a-1cd5c803be31 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-vif-unplugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a3e716bf-0fdc-4d19-96f2-58389d8f7737 req-315c3e2d-d9f0-4b7b-8f9a-1cd5c803be31 service nova] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a3e716bf-0fdc-4d19-96f2-58389d8f7737 req-315c3e2d-d9f0-4b7b-8f9a-1cd5c803be31 service nova] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a3e716bf-0fdc-4d19-96f2-58389d8f7737 req-315c3e2d-d9f0-4b7b-8f9a-1cd5c803be31 service nova] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-a3e716bf-0fdc-4d19-96f2-58389d8f7737 req-315c3e2d-d9f0-4b7b-8f9a-1cd5c803be31 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] No waiting events found dispatching network-vif-unplugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-a3e716bf-0fdc-4d19-96f2-58389d8f7737 req-315c3e2d-d9f0-4b7b-8f9a-1cd5c803be31 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-vif-unplugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-8b51a260-36f9-468e-b2e1-6f3571806f83 req-4e40271d-0c83-4649-9ce2-c67fd0268101 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updated VIF entry in instance network info cache for port c36a4179-ca05-42e1-9722-5b6b0988dd40. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-8b51a260-36f9-468e-b2e1-6f3571806f83 req-4e40271d-0c83-4649-9ce2-c67fd0268101 service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updating instance_info_cache with network_info: [{"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8b51a260-36f9-468e-b2e1-6f3571806f83 req-4e40271d-0c83-4649-9ce2-c67fd0268101 service nova] Releasing lock "refresh_cache-5279904e-b465-44d4-a3b9-8e7b3bcac17a" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:01:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Instance destroyed successfully.
Dec 01 14:01:13 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'resources' on Instance uuid 5279904e-b465-44d4-a3b9-8e7b3bcac17a {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-374442381',display_name='tempest-TestStampPattern-server-374442381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-374442381',id=36,image_ref='2e8b0280-8a64-41d9-b674-ee1754e37f32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL+EHm/xpEHocK4PGywUkdMgPUm3PvVQCZAtgnyMweWmGc4EZJmIRhcUDceKjjDUHaGiGhpCbY1eWeuL2sbOcyDf9YOZ/RySTwVTw18QS5oHeN1VGNdG51gHPory5yiNw==',key_name='tempest-TestStampPattern-1491628277',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:58:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='265995abf58f45f3bbcf9a9763b30f7c',ramdisk_id='',reservation_id='r-nauepk1t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='60ed46b9-cae1-4bd5-bd37-6fdada399023',image_min_disk='1',image_min_ram='0',image_owner_id='265995abf58f45f3bbcf9a9763b30f7c',image_owner_project_name='tempest-TestStampPattern-1525886470',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1525886470-project-member',image_user_id='35b2de5a7fb5488ba4e0e6204e730a97',owner_project_name='tempest-TestStampPattern-1525886470',owner_user_name='tempest-TestStampPattern-1525886470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:58:22Z,user_data=None,user_id='35b2de5a7fb5488ba4e0e6204e730a97',uuid=5279904e-b465-44d4-a3b9-8e7b3bcac17a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converting VIF {"id": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "address": "fa:16:3e:39:85:a8", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc36a4179-ca", "ovs_interfaceid": "c36a4179-ca05-42e1-9722-5b6b0988dd40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=c36a4179-ca05-42e1-9722-5b6b0988dd40,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36a4179-ca') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG os_vif [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=c36a4179-ca05-42e1-9722-5b6b0988dd40,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36a4179-ca') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc36a4179-ca, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbdc0e4c-c053-4684-a0a8-6de6e2852033) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:01:13 user nova-compute[75288]: INFO os_vif [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=c36a4179-ca05-42e1-9722-5b6b0988dd40,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc36a4179-ca')
Dec 01 14:01:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Deleting instance files /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a_del
Dec 01 14:01:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Deletion of /opt/stack/data/nova/instances/5279904e-b465-44d4-a3b9-8e7b3bcac17a_del complete
Dec 01 14:01:13 user nova-compute[75288]: INFO nova.compute.manager [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Took 1.25 seconds to destroy the instance on the hypervisor.
Dec 01 14:01:13 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:01:13 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-6908a3c0-36c2-413d-8de0-2ed3a971679b req-dc17a8a7-65ca-441a-bf00-a5796064e5cc service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-vif-deleted-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:14 user nova-compute[75288]: INFO nova.compute.manager [req-6908a3c0-36c2-413d-8de0-2ed3a971679b req-dc17a8a7-65ca-441a-bf00-a5796064e5cc service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Neutron deleted interface c36a4179-ca05-42e1-9722-5b6b0988dd40; detaching it from the instance and deleting it from the info cache
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.network.neutron [req-6908a3c0-36c2-413d-8de0-2ed3a971679b req-dc17a8a7-65ca-441a-bf00-a5796064e5cc service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:01:14 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Took 1.17 seconds to deallocate network for instance.
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-6908a3c0-36c2-413d-8de0-2ed3a971679b req-dc17a8a7-65ca-441a-bf00-a5796064e5cc service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Detach interface failed, port_id=c36a4179-ca05-42e1-9722-5b6b0988dd40, reason: Instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-99e22f67-b430-4484-bc75-d2433c9f92f0 req-c7a9502b-2c6e-4e3a-9190-cd4dcccab9ca service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received event network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-99e22f67-b430-4484-bc75-d2433c9f92f0 req-c7a9502b-2c6e-4e3a-9190-cd4dcccab9ca service nova] Acquiring lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-99e22f67-b430-4484-bc75-d2433c9f92f0 req-c7a9502b-2c6e-4e3a-9190-cd4dcccab9ca service nova] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-99e22f67-b430-4484-bc75-d2433c9f92f0 req-c7a9502b-2c6e-4e3a-9190-cd4dcccab9ca service nova] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-99e22f67-b430-4484-bc75-d2433c9f92f0 req-c7a9502b-2c6e-4e3a-9190-cd4dcccab9ca service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] No waiting events found dispatching network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:01:14 user nova-compute[75288]: WARNING nova.compute.manager [req-99e22f67-b430-4484-bc75-d2433c9f92f0 req-c7a9502b-2c6e-4e3a-9190-cd4dcccab9ca service nova] [instance: 5279904e-b465-44d4-a3b9-8e7b3bcac17a] Received unexpected event network-vif-plugged-c36a4179-ca05-42e1-9722-5b6b0988dd40 for instance with vm_state deleted and task_state None.
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:14 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:15 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Deleted allocations for instance 5279904e-b465-44d4-a3b9-8e7b3bcac17a
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6733b82e-45e3-4d2b-8109-7c857c309994 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "5279904e-b465-44d4-a3b9-8e7b3bcac17a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.211s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:01:17 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=7889MB free_disk=24.940940856933594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 60ed46b9-cae1-4bd5-bd37-6fdada399023 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance b4211312-8a32-4723-801d-47c3db348668 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 28c7d2bd-7c14-4dbd-a798-48eb6546c51c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 9ae651bf-c461-46e1-bc89-182740d6fe04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:01:17 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:01:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:01:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updating instance_info_cache with network_info: [{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:20 user nova-compute[75288]: INFO nova.compute.manager [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Terminating instance
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-88d4d10a-6705-4e43-b1b8-33813a06a2a6 req-655e8f64-8cbd-4344-80af-f847ece50206 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-unplugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88d4d10a-6705-4e43-b1b8-33813a06a2a6 req-655e8f64-8cbd-4344-80af-f847ece50206 service nova] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88d4d10a-6705-4e43-b1b8-33813a06a2a6 req-655e8f64-8cbd-4344-80af-f847ece50206 service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88d4d10a-6705-4e43-b1b8-33813a06a2a6 req-655e8f64-8cbd-4344-80af-f847ece50206 service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-88d4d10a-6705-4e43-b1b8-33813a06a2a6 req-655e8f64-8cbd-4344-80af-f847ece50206 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] No waiting events found dispatching network-vif-unplugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-88d4d10a-6705-4e43-b1b8-33813a06a2a6 req-655e8f64-8cbd-4344-80af-f847ece50206 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-unplugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:01:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: b4211312-8a32-4723-801d-47c3db348668] Instance destroyed successfully.
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.objects.instance [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'resources' on Instance uuid b4211312-8a32-4723-801d-47c3db348668 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1258491341',display_name='tempest-ServerActionsTestOtherA-server-1258491341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1258491341',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:56:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-75q0eqf8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=b4211312-8a32-4723-801d-47c3db348668,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "address": "fa:16:3e:35:47:eb", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830b3d65-26", "ovs_interfaceid": "830b3d65-26cd-4266-a4a7-67dd9cf6dd5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_vif [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap830b3d65-26, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a79b86d-76f9-4337-8dfc-9e334a7b4bb5) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:20 user nova-compute[75288]: INFO os_vif [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:eb,bridge_name='br-int',has_traffic_filtering=True,id=830b3d65-26cd-4266-a4a7-67dd9cf6dd5b,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830b3d65-26')
Dec 01 14:01:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjbTQnir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:01:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465f060-950f-49a2-844a-fc286044b85b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:01:20 user nova-compute[75288]: No targets found.
Dec 01 14:01:20 user nova-compute[75288]: iSNS:
Dec 01 14:01:20 user nova-compute[75288]: No targets found.
Dec 01 14:01:20 user nova-compute[75288]: STATIC:
Dec 01 14:01:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34
Dec 01 14:01:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:01:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:01:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:01:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:01:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:01:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260
Dec 01 14:01:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:01:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:01:20 user nova-compute[75288]: FIRMWARE:
Dec 01 14:01:20 user nova-compute[75288]: No targets found.
Dec 01 14:01:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:01:20 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:01:20 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a82c44-c4bc-4f35-8481-1a6d8de56951]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[110388d1-8ac7-4831-8bdb-1d4db4213535]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:01:20 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:01:20 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:01:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:01:20 user nova-compute[75288]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 (non-flash)
Dec 01 14:01:20 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:01:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e70160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:01:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[957a081d-12eb-441a-85de-c27de589c482]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac435980-c1ad-40f6-a122-41b8f544ecfb]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85f9e77-a185-46eb-af0d-f726df562b01]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9a6d1a-b443-4127-ad71-e537e4a5c7ea]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb13ada9-1f91-4e9e-bc7d-6df0872f1761]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbd601a-6e1e-4032-8956-c93d945a76f6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260]
Dec 01 14:01:21 user nova-compute[75288]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260, portal: 172.16.0.220,3260] successful.
Dec 01 14:01:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d75223d-31e1-4691-98bd-d039f7ec5260 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e0974c-3cd3-4a5d-93c5-b206d43963e0]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] <== disconnect_volume: return (350ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:01:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Deleting instance files /opt/stack/data/nova/instances/b4211312-8a32-4723-801d-47c3db348668_del
Dec 01 14:01:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Deletion of /opt/stack/data/nova/instances/b4211312-8a32-4723-801d-47c3db348668_del complete
Dec 01 14:01:21 user nova-compute[75288]: INFO nova.compute.manager [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Took 1.23 seconds to destroy the instance on the hypervisor.
Dec 01 14:01:21 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: b4211312-8a32-4723-801d-47c3db348668] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:01:21 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b4211312-8a32-4723-801d-47c3db348668] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:01:22 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: b4211312-8a32-4723-801d-47c3db348668] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:01:22 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: b4211312-8a32-4723-801d-47c3db348668] Took 0.91 seconds to deallocate network for instance.
Dec 01 14:01:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-aa196ffa-b1b8-4c79-a9ce-c3ff04807281 req-fc547329-234f-4ddb-be04-67c7a652df14 service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-deleted-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-88bb9231-bf38-4393-9e88-ca85c0fdf597 req-5369e1b4-e15a-494e-8467-db8c73f3516c service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88bb9231-bf38-4393-9e88-ca85c0fdf597 req-5369e1b4-e15a-494e-8467-db8c73f3516c service nova] Acquiring lock "b4211312-8a32-4723-801d-47c3db348668-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88bb9231-bf38-4393-9e88-ca85c0fdf597 req-5369e1b4-e15a-494e-8467-db8c73f3516c service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88bb9231-bf38-4393-9e88-ca85c0fdf597 req-5369e1b4-e15a-494e-8467-db8c73f3516c service nova] Lock "b4211312-8a32-4723-801d-47c3db348668-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-88bb9231-bf38-4393-9e88-ca85c0fdf597 req-5369e1b4-e15a-494e-8467-db8c73f3516c service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] No waiting events found dispatching network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:01:22 user nova-compute[75288]: WARNING nova.compute.manager [req-88bb9231-bf38-4393-9e88-ca85c0fdf597 req-5369e1b4-e15a-494e-8467-db8c73f3516c service nova] [instance: b4211312-8a32-4723-801d-47c3db348668] Received unexpected event network-vif-plugged-830b3d65-26cd-4266-a4a7-67dd9cf6dd5b for instance with vm_state active and task_state deleting.
Dec 01 14:01:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:23 user nova-compute[75288]: INFO nova.compute.manager [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Took 0.89 seconds to detach 1 volumes for instance.
Dec 01 14:01:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: b4211312-8a32-4723-801d-47c3db348668] Deleting volume: 5d75223d-31e1-4691-98bd-d039f7ec5260 {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 14:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:01:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:01:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:01:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:23 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Deleted allocations for instance b4211312-8a32-4723-801d-47c3db348668
Dec 01 14:01:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-234ed673-7160-4e26-9e8a-66383b087a5f tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "b4211312-8a32-4723-801d-47c3db348668" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.693s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:01:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:01:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:01:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:01:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:02:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f53d95a-4efc-4e6b-92fc-6e00e2a3c1a2 req-6605f4b4-ce27-4ea9-812d-71f6b8f43933 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-changed-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-6f53d95a-4efc-4e6b-92fc-6e00e2a3c1a2 req-6605f4b4-ce27-4ea9-812d-71f6b8f43933 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Refreshing instance network info cache due to event network-changed-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f53d95a-4efc-4e6b-92fc-6e00e2a3c1a2 req-6605f4b4-ce27-4ea9-812d-71f6b8f43933 service nova] Acquiring lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f53d95a-4efc-4e6b-92fc-6e00e2a3c1a2 req-6605f4b4-ce27-4ea9-812d-71f6b8f43933 service nova] Acquired lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-6f53d95a-4efc-4e6b-92fc-6e00e2a3c1a2 req-6605f4b4-ce27-4ea9-812d-71f6b8f43933 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Refreshing network info cache for port dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:13 user nova-compute[75288]: INFO nova.compute.manager [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Terminating instance
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-6f53d95a-4efc-4e6b-92fc-6e00e2a3c1a2 req-6605f4b4-ce27-4ea9-812d-71f6b8f43933 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updated VIF entry in instance network info cache for port dd2bd589-71cc-43dd-929f-8ccc0cb15d5e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-6f53d95a-4efc-4e6b-92fc-6e00e2a3c1a2 req-6605f4b4-ce27-4ea9-812d-71f6b8f43933 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updating instance_info_cache with network_info: [{"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6f53d95a-4efc-4e6b-92fc-6e00e2a3c1a2 req-6605f4b4-ce27-4ea9-812d-71f6b8f43933 service nova] Releasing lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:02:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Instance destroyed successfully.
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lazy-loading 'resources' on Instance uuid 60ed46b9-cae1-4bd5-bd37-6fdada399023 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:55:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2106884728',display_name='tempest-TestStampPattern-server-2106884728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2106884728',id=33,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL+EHm/xpEHocK4PGywUkdMgPUm3PvVQCZAtgnyMweWmGc4EZJmIRhcUDceKjjDUHaGiGhpCbY1eWeuL2sbOcyDf9YOZ/RySTwVTw18QS5oHeN1VGNdG51gHPory5yiNw==',key_name='tempest-TestStampPattern-1491628277',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:55:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='265995abf58f45f3bbcf9a9763b30f7c',ramdisk_id='',reservation_id='r-zq1jck45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1525886470',owner_user_name='tempest-TestStampPattern-1525886470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:58:13Z,user_data=None,user_id='35b2de5a7fb5488ba4e0e6204e730a97',uuid=60ed46b9-cae1-4bd5-bd37-6fdada399023,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converting VIF {"id": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "address": "fa:16:3e:79:15:90", "network": {"id": "186bad6c-7d42-4831-a795-22a7a6e18054", "bridge": "br-int", "label": "tempest-TestStampPattern-1440078861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "265995abf58f45f3bbcf9a9763b30f7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd2bd589-71", "ovs_interfaceid": "dd2bd589-71cc-43dd-929f-8ccc0cb15d5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:90,bridge_name='br-int',has_traffic_filtering=True,id=dd2bd589-71cc-43dd-929f-8ccc0cb15d5e,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd2bd589-71') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG os_vif [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:90,bridge_name='br-int',has_traffic_filtering=True,id=dd2bd589-71cc-43dd-929f-8ccc0cb15d5e,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd2bd589-71') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd2bd589-71, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9abc780f-e875-4ade-9551-ec29bbfae806) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:02:14 user nova-compute[75288]: INFO os_vif [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:15:90,bridge_name='br-int',has_traffic_filtering=True,id=dd2bd589-71cc-43dd-929f-8ccc0cb15d5e,network=Network(186bad6c-7d42-4831-a795-22a7a6e18054),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd2bd589-71')
Dec 01 14:02:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Deleting instance files /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023_del
Dec 01 14:02:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Deletion of /opt/stack/data/nova/instances/60ed46b9-cae1-4bd5-bd37-6fdada399023_del complete
Dec 01 14:02:14 user nova-compute[75288]: INFO nova.compute.manager [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 01 14:02:14 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-639ab9a5-2acc-4524-9b09-ba2d55c5e7d0 req-f79c8b5b-daf6-4f87-8372-b0e198e5e7fd service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-vif-unplugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-639ab9a5-2acc-4524-9b09-ba2d55c5e7d0 req-f79c8b5b-daf6-4f87-8372-b0e198e5e7fd service nova] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-639ab9a5-2acc-4524-9b09-ba2d55c5e7d0 req-f79c8b5b-daf6-4f87-8372-b0e198e5e7fd service nova] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-639ab9a5-2acc-4524-9b09-ba2d55c5e7d0 req-f79c8b5b-daf6-4f87-8372-b0e198e5e7fd service nova] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-639ab9a5-2acc-4524-9b09-ba2d55c5e7d0 req-f79c8b5b-daf6-4f87-8372-b0e198e5e7fd service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] No waiting events found dispatching network-vif-unplugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG nova.compute.manager [req-639ab9a5-2acc-4524-9b09-ba2d55c5e7d0 req-f79c8b5b-daf6-4f87-8372-b0e198e5e7fd service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-vif-unplugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:02:14 user nova-compute[75288]: INFO nova.compute.manager [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Rescuing
Dec 01 14:02:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquired lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:02:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:15 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Took 1.20 seconds to deallocate network for instance.
Dec 01 14:02:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Updating instance_info_cache with network_info: [{"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Releasing lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:02:15 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Deleted allocations for instance 60ed46b9-cae1-4bd5-bd37-6fdada399023
Dec 01 14:02:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a19204-f514-4da6-8534-1bb5ba713cb3 tempest-TestStampPattern-1525886470 tempest-TestStampPattern-1525886470-project-member] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.730s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-815da6a6-fe5f-4059-ba12-a6e2066caa5d req-4625df65-25a3-49b4-8534-3f4ad414063e service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-815da6a6-fe5f-4059-ba12-a6e2066caa5d req-4625df65-25a3-49b4-8534-3f4ad414063e service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-815da6a6-fe5f-4059-ba12-a6e2066caa5d req-4625df65-25a3-49b4-8534-3f4ad414063e service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-815da6a6-fe5f-4059-ba12-a6e2066caa5d req-4625df65-25a3-49b4-8534-3f4ad414063e service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-815da6a6-fe5f-4059-ba12-a6e2066caa5d req-4625df65-25a3-49b4-8534-3f4ad414063e service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:16 user nova-compute[75288]: WARNING nova.compute.manager [req-815da6a6-fe5f-4059-ba12-a6e2066caa5d req-4625df65-25a3-49b4-8534-3f4ad414063e service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state active and task_state rescuing.
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-60ed46b9-cae1-4bd5-bd37-6fdada399023" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:02:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance destroyed successfully.
Dec 01 14:02:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Attempting a stable device rescue
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75288) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance directory exists: not creating {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 14:02:16 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Creating image(s)
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "/opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "/opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "/opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'trusted_certs' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "9684f20df0ab71bccdca89e09e5005b9c3b2c35f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "9684f20df0ab71bccdca89e09e5005b9c3b2c35f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:16 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:02:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-c469946f-6b70-4267-9046-8cdbfbecc9ac req-df9940ad-e350-4737-8e16-dd0bc09d87b4 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c469946f-6b70-4267-9046-8cdbfbecc9ac req-df9940ad-e350-4737-8e16-dd0bc09d87b4 service nova] Acquiring lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c469946f-6b70-4267-9046-8cdbfbecc9ac req-df9940ad-e350-4737-8e16-dd0bc09d87b4 service nova] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c469946f-6b70-4267-9046-8cdbfbecc9ac req-df9940ad-e350-4737-8e16-dd0bc09d87b4 service nova] Lock "60ed46b9-cae1-4bd5-bd37-6fdada399023-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-c469946f-6b70-4267-9046-8cdbfbecc9ac req-df9940ad-e350-4737-8e16-dd0bc09d87b4 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] No waiting events found dispatching network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:18 user nova-compute[75288]: WARNING nova.compute.manager [req-c469946f-6b70-4267-9046-8cdbfbecc9ac req-df9940ad-e350-4737-8e16-dd0bc09d87b4 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received unexpected event network-vif-plugged-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e for instance with vm_state deleted and task_state None.
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-c469946f-6b70-4267-9046-8cdbfbecc9ac req-df9940ad-e350-4737-8e16-dd0bc09d87b4 service nova] [instance: 60ed46b9-cae1-4bd5-bd37-6fdada399023] Received event network-vif-deleted-dd2bd589-71cc-43dd-929f-8ccc0cb15d5e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:18 user nova-compute[75288]: INFO nova.compute.manager [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Terminating instance
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.virt.images [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] 5c734adf-cc90-4675-bd6a-67939720b3de was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f.part /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-ca46d03d-d88a-4a38-844c-56f76672d570 req-32afae5d-c16e-4346-a620-03cad41538fa service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca46d03d-d88a-4a38-844c-56f76672d570 req-32afae5d-c16e-4346-a620-03cad41538fa service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca46d03d-d88a-4a38-844c-56f76672d570 req-32afae5d-c16e-4346-a620-03cad41538fa service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ca46d03d-d88a-4a38-844c-56f76672d570 req-32afae5d-c16e-4346-a620-03cad41538fa service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-ca46d03d-d88a-4a38-844c-56f76672d570 req-32afae5d-c16e-4346-a620-03cad41538fa service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:18 user nova-compute[75288]: WARNING nova.compute.manager [req-ca46d03d-d88a-4a38-844c-56f76672d570 req-32afae5d-c16e-4346-a620-03cad41538fa service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state active and task_state rescuing.
Dec 01 14:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f.part /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f.converted" returned: 0 in 0.679s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Instance destroyed successfully.
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.objects.instance [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lazy-loading 'resources' on Instance uuid 03de2627-2167-48c9-94cb-bd57c18f87c8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1856732204',display_name='tempest-ServerActionsTestOtherA-server-1856732204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1856732204',id=1,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTOTPduQN3i470RbxIJ5gLcCEYSCdtoFvEP1uRRSDhMqwuoTz8V1DoAlsID3qTZX4Mf26dACB0zD5poGMUb9MX+0HeyJhH45tHAzIQPvMyH9gVlxTBqnLSYfxZDshsxRQ==',key_name='tempest-keypair-1620114158',keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:43:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85fa93e7dad94355a81ee3193a26d19a',ramdisk_id='',reservation_id='r-m116rm5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1200563250',owner_user_name='tempest-ServerActionsTestOtherA-1200563250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a8b600efb9d47b6991cbde8b34b9a1f',uuid=03de2627-2167-48c9-94cb-bd57c18f87c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converting VIF {"id": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "address": "fa:16:3e:f1:9f:49", "network": {"id": "c1847d46-f40f-4b33-881d-cc50af07709c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1934493457-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85fa93e7dad94355a81ee3193a26d19a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape66de3d0-23", "ovs_interfaceid": "e66de3d0-2331-4afa-8613-0cc8bc289deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:9f:49,bridge_name='br-int',has_traffic_filtering=True,id=e66de3d0-2331-4afa-8613-0cc8bc289deb,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66de3d0-23') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG os_vif [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:9f:49,bridge_name='br-int',has_traffic_filtering=True,id=e66de3d0-2331-4afa-8613-0cc8bc289deb,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66de3d0-23') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape66de3d0-23, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:02:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9127828-6d8b-4d0f-8bb9-ea89a06642d3) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:19 user nova-compute[75288]: INFO os_vif [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:9f:49,bridge_name='br-int',has_traffic_filtering=True,id=e66de3d0-2331-4afa-8613-0cc8bc289deb,network=Network(c1847d46-f40f-4b33-881d-cc50af07709c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape66de3d0-23')
Dec 01 14:02:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Deleting instance files /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8_del
Dec 01 14:02:19 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Deletion of /opt/stack/data/nova/instances/03de2627-2167-48c9-94cb-bd57c18f87c8_del complete
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "9684f20df0ab71bccdca89e09e5005b9c3b2c35f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.433s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "9684f20df0ab71bccdca89e09e5005b9c3b2c35f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "9684f20df0ab71bccdca89e09e5005b9c3b2c35f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: INFO nova.compute.manager [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Took 1.02 seconds to destroy the instance on the hypervisor.
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f,backing_fmt=raw /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.rescue {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f,backing_fmt=raw /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.rescue" returned: 0 in 0.048s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "9684f20df0ab71bccdca89e09e5005b9c3b2c35f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'migration_context' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<28c7d2bd-7c14-4dbd-a798-48eb6546c51c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Start _get_guest_xml network_info=[{"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "vif_mac": "fa:16:3e:7a:5e:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5c734adf-cc90-4675-bd6a-67939720b3de', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'abdeed6c-72ae-439d-bb76-b10367520316', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buMekcFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '28c7d2bd-7c14-4dbd-a798-48eb6546c51c', 'attached_at': '', 'detached_at': '', 'volume_id': '501208d1-fba1-41f1-87e1-d71db7cfed34', 'serial': '501208d1-fba1-41f1-87e1-d71db7cfed34'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'resources' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<28c7d2bd-7c14-4dbd-a798-48eb6546c51c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'numa_topology' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid '03de2627-2167-48c9-94cb-bd57c18f87c8' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid '03de2627-2167-48c9-94cb-bd57c18f87c8' (instance-00000001)
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<28c7d2bd-7c14-4dbd-a798-48eb6546c51c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:02:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<28c7d2bd-7c14-4dbd-a798-48eb6546c51c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buMekcFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:02:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:02:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:02:19 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[35871aaf-912b-4244-a4de-f52b55f02595]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = buMekcFr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 14:02:19 user nova-compute[75288]: node.name = iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34
Dec 01 14:02:19 user nova-compute[75288]: node.tpgt = -1
Dec 01 14:02:19 user nova-compute[75288]: node.startup = automatic
Dec 01 14:02:19 user nova-compute[75288]: node.leading_login = No
Dec 01 14:02:19 user nova-compute[75288]: iface.iscsi_ifacename = default
Dec 01 14:02:19 user nova-compute[75288]: iface.net_ifacename = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.ipaddress = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.prefix_len = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.hwaddress = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.transport_name = tcp
Dec 01 14:02:19 user nova-compute[75288]: iface.initiatorname = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.state = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.vlan_id = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.vlan_priority = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.vlan_state = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.iface_num = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.mtu = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.port = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.bootproto = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.subnet_mask = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.gateway = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.dhcp_alt_client_id = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.dhcp_dns = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.dhcp_learn_iqn = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.dhcp_vendor_id_state = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.dhcp_vendor_id = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.dhcp_slp_da = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.fragmentation = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.gratuitous_arp = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.incoming_forwarding = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.tos_state = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.tos = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.ttl = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.delayed_ack = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.tcp_nagle = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.tcp_wsf_state = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.tcp_wsf = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.tcp_timer_scale = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.tcp_timestamp = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.redirect = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.def_task_mgmt_timeout = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.header_digest = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.data_digest = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.immediate_data = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.initial_r2t = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.data_seq_inorder = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.data_pdu_inorder = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.erl = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.max_receive_data_len = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.first_burst_len = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.max_outstanding_r2t = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.max_burst_len = 0
Dec 01 14:02:19 user nova-compute[75288]: iface.chap_auth = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.bidi_chap = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.strict_login_compliance = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.discovery_auth = <empty>
Dec 01 14:02:19 user nova-compute[75288]: iface.discovery_logout = <empty>
Dec 01 14:02:19 user nova-compute[75288]: node.discovery_address = <empty>
Dec 01 14:02:19 user nova-compute[75288]: node.discovery_port = 0
Dec 01 14:02:19 user nova-compute[75288]: node.discovery_type = static
Dec 01 14:02:19 user nova-compute[75288]: node.session.initial_cmdsn = 0
Dec 01 14:02:19 user nova-compute[75288]: node.session.initial_login_retry_max = 8
Dec 01 14:02:19 user nova-compute[75288]: node.session.xmit_thread_priority = -20
Dec 01 14:02:19 user nova-compute[75288]: node.session.cmds_max = 128
Dec 01 14:02:19 user nova-compute[75288]: node.session.queue_depth = 32
Dec 01 14:02:19 user nova-compute[75288]: node.session.nr_sessions = 1
Dec 01 14:02:19 user nova-compute[75288]: node.session.auth.authmethod = CHAP
Dec 01 14:02:19 user nova-compute[75288]: node.session.auth.username = buMekcFr
Dec 01 14:02:19 user nova-compute[75288]: node.session.auth.password = ***
Dec 01 14:02:19 user nova-compute[75288]: node.session.auth.username_in = <empty>
Dec 01 14:02:19 user nova-compute[75288]: node.session.auth.password_in = <empty>
Dec 01 14:02:19 user nova-compute[75288]: node.session.auth.chap_algs = MD5
Dec 01 14:02:19 user nova-compute[75288]: node.session.timeo.replacement_timeout = 120
Dec 01 14:02:19 user nova-compute[75288]: node.session.err_timeo.abort_timeout = 15
Dec 01 14:02:19 user nova-compute[75288]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 14:02:19 user nova-compute[75288]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 14:02:19 user nova-compute[75288]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.FastAbort = Yes
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.InitialR2T = No
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.ImmediateData = Yes
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.MaxConnections = 1
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 14:02:19 user nova-compute[75288]: node.session.iscsi.ERL = 0
Dec 01 14:02:19 user nova-compute[75288]: node.session.scan = manual
Dec 01 14:02:19 user nova-compute[75288]: node.session.reopen_max = 0
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].address = 172.16.0.220
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].port = 3260
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].startup = manual
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].tcp.window_size = 524288
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].tcp.type_of_service = 0
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].timeo.logout_timeout = 15
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].timeo.login_timeout = 15
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].timeo.auth_timeout = 45
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].iscsi.DataDigest = None
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].iscsi.IFMarker = No
Dec 01 14:02:19 user nova-compute[75288]: node.conn[0].iscsi.OFMarker = No
Dec 01 14:02:19 user nova-compute[75288]: # END RECORD
Dec 01 14:02:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[47010f87-5f90-43a1-ac6f-5b2fa33e2d35]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf9d820-8f27-419d-9405-2b4f0d4d2b8f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buMekcFr {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v buMekcFr" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ec8940-58b5-49bf-8c25-05f258d83210]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'buMekcFr'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d78518-bd92-42d7-a61f-dbddc7dc585e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c6e9b3-f8b7-4fcd-a1d1-d5fc95a86f14]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:02:19 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:02:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:02:19 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:02:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] HCTL ('35', '0', '0', 0) found on session 37 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[516137c6-d655-42ef-8057-fdf20b500958]: (4, ('0 0 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Searching for a device in session 37 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buMekcFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23230623162393038', 'path': '/dev/sdd'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230623162393038', 'path': '/dev/sdd'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-249953189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-249953189',id=37,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:00:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-jcvt2cdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:00:50Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=28c7d2bd-7c14-4dbd-a798-48eb6546c51c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "vif_mac": "fa:16:3e:7a:5e:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "vif_mac": "fa:16:3e:7a:5e:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:5e:04,bridge_name='br-int',has_traffic_filtering=True,id=53631e8a-d098-4366-9070-7a6c5e255f48,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53631e8a-d0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:02:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'pci_devices' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.objects.base [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Object Instance<28c7d2bd-7c14-4dbd-a798-48eb6546c51c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:02:20 user nova-compute[75288]:   <uuid>28c7d2bd-7c14-4dbd-a798-48eb6546c51c</uuid>
Dec 01 14:02:20 user nova-compute[75288]:   <name>instance-00000025</name>
Dec 01 14:02:20 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:02:20 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:02:20 user nova-compute[75288]:   <metadata>
Dec 01 14:02:20 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:02:20 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:02:20 user nova-compute[75288]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-249953189</nova:name>
Dec 01 14:02:20 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:02:19</nova:creationTime>
Dec 01 14:02:20 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:02:20 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:02:20 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:02:20 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:02:20 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:02:20 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:02:20 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:02:20 user nova-compute[75288]:       <nova:owner>
Dec 01 14:02:20 user nova-compute[75288]:         <nova:user uuid="69266afe5e404e259d679d7498f99faa">tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member</nova:user>
Dec 01 14:02:20 user nova-compute[75288]:         <nova:project uuid="2e6b677b10d14d63984895b4cfbdad4b">tempest-ServerBootFromVolumeStableRescueTest-64531845</nova:project>
Dec 01 14:02:20 user nova-compute[75288]:       </nova:owner>
Dec 01 14:02:20 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:02:20 user nova-compute[75288]:       <nova:ports>
Dec 01 14:02:20 user nova-compute[75288]:         <nova:port uuid="53631e8a-d098-4366-9070-7a6c5e255f48">
Dec 01 14:02:20 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 14:02:20 user nova-compute[75288]:         </nova:port>
Dec 01 14:02:20 user nova-compute[75288]:       </nova:ports>
Dec 01 14:02:20 user nova-compute[75288]:     </nova:instance>
Dec 01 14:02:20 user nova-compute[75288]:   </metadata>
Dec 01 14:02:20 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:02:20 user nova-compute[75288]:     <system>
Dec 01 14:02:20 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:02:20 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:02:20 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:02:20 user nova-compute[75288]:       <entry name="serial">28c7d2bd-7c14-4dbd-a798-48eb6546c51c</entry>
Dec 01 14:02:20 user nova-compute[75288]:       <entry name="uuid">28c7d2bd-7c14-4dbd-a798-48eb6546c51c</entry>
Dec 01 14:02:20 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:02:20 user nova-compute[75288]:     </system>
Dec 01 14:02:20 user nova-compute[75288]:   </sysinfo>
Dec 01 14:02:20 user nova-compute[75288]:   <os>
Dec 01 14:02:20 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:02:20 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:02:20 user nova-compute[75288]:   </os>
Dec 01 14:02:20 user nova-compute[75288]:   <features>
Dec 01 14:02:20 user nova-compute[75288]:     <acpi/>
Dec 01 14:02:20 user nova-compute[75288]:     <apic/>
Dec 01 14:02:20 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:02:20 user nova-compute[75288]:   </features>
Dec 01 14:02:20 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:02:20 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:02:20 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:02:20 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:02:20 user nova-compute[75288]:   </clock>
Dec 01 14:02:20 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:02:20 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:02:20 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:02:20 user nova-compute[75288]:   </cpu>
Dec 01 14:02:20 user nova-compute[75288]:   <devices>
Dec 01 14:02:20 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 14:02:20 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:02:20 user nova-compute[75288]:       <source dev="/dev/sdd"/>
Dec 01 14:02:20 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:02:20 user nova-compute[75288]:       <serial>501208d1-fba1-41f1-87e1-d71db7cfed34</serial>
Dec 01 14:02:20 user nova-compute[75288]:     </disk>
Dec 01 14:02:20 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:02:20 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:02:20 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.rescue"/>
Dec 01 14:02:20 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 14:02:20 user nova-compute[75288]:       <boot order="1"/>
Dec 01 14:02:20 user nova-compute[75288]:     </disk>
Dec 01 14:02:20 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:02:20 user nova-compute[75288]:       <mac address="fa:16:3e:7a:5e:04"/>
Dec 01 14:02:20 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:02:20 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:02:20 user nova-compute[75288]:       <target dev="tap53631e8a-d0"/>
Dec 01 14:02:20 user nova-compute[75288]:     </interface>
Dec 01 14:02:20 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:02:20 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/console.log" append="off"/>
Dec 01 14:02:20 user nova-compute[75288]:     </serial>
Dec 01 14:02:20 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:02:20 user nova-compute[75288]:     <video>
Dec 01 14:02:20 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:02:20 user nova-compute[75288]:     </video>
Dec 01 14:02:20 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:02:20 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:02:20 user nova-compute[75288]:     </rng>
Dec 01 14:02:20 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:02:20 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:02:20 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:02:20 user nova-compute[75288]:     </memballoon>
Dec 01 14:02:20 user nova-compute[75288]:   </devices>
Dec 01 14:02:20 user nova-compute[75288]: </domain>
Dec 01 14:02:20 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b66f061-a68a-44bf-b03e-a5b353dfc044 req-25728a96-9e42-40c6-a60f-f6cabdbd55f0 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received event network-vif-deleted-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:20 user nova-compute[75288]: INFO nova.compute.manager [req-6b66f061-a68a-44bf-b03e-a5b353dfc044 req-25728a96-9e42-40c6-a60f-f6cabdbd55f0 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Neutron deleted interface e66de3d0-2331-4afa-8613-0cc8bc289deb; detaching it from the instance and deleting it from the info cache
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.network.neutron [req-6b66f061-a68a-44bf-b03e-a5b353dfc044 req-25728a96-9e42-40c6-a60f-f6cabdbd55f0 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:02:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=25.02362060546875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:20 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Took 1.04 seconds to deallocate network for instance.
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b66f061-a68a-44bf-b03e-a5b353dfc044 req-25728a96-9e42-40c6-a60f-f6cabdbd55f0 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Detach interface failed, port_id=e66de3d0-2331-4afa-8613-0cc8bc289deb, reason: Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:02:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance destroyed successfully.
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] No VIF found with MAC fa:16:3e:7a:5e:04, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 03de2627-2167-48c9-94cb-bd57c18f87c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 28c7d2bd-7c14-4dbd-a798-48eb6546c51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 9ae651bf-c461-46e1-bc89-182740d6fe04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received event network-vif-unplugged-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] No waiting events found dispatching network-vif-unplugged-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:20 user nova-compute[75288]: WARNING nova.compute.manager [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received unexpected event network-vif-unplugged-e66de3d0-2331-4afa-8613-0cc8bc289deb for instance with vm_state deleted and task_state None.
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received event network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] Acquiring lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] No waiting events found dispatching network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:20 user nova-compute[75288]: WARNING nova.compute.manager [req-88eb882d-d40a-45a1-bf08-cf1c79516a87 req-6bcf296f-6b50-4dab-8f2f-694ea10b2ec2 service nova] [instance: 03de2627-2167-48c9-94cb-bd57c18f87c8] Received unexpected event network-vif-plugged-e66de3d0-2331-4afa-8613-0cc8bc289deb for instance with vm_state deleted and task_state None.
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.353s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:02:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:20 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Deleted allocations for instance 03de2627-2167-48c9-94cb-bd57c18f87c8
Dec 01 14:02:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17c1a3f3-aaa3-4904-8b82-73c3fd82d7ed tempest-ServerActionsTestOtherA-1200563250 tempest-ServerActionsTestOtherA-1200563250-project-member] Lock "03de2627-2167-48c9-94cb-bd57c18f87c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:02:21 user nova-compute[75288]: INFO nova.compute.claims [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Claim successful on node user
Dec 01 14:02:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:02:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:02:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:02:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.policy [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca29852ee4b449c588d19457634538e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '665e8f7b1e514cd182ce6e1977e4a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:02:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Creating image(s)
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "/opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "/opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.198s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:22 user nova-compute[75288]: WARNING nova.compute.manager [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state active and task_state rescuing.
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:22 user nova-compute[75288]: WARNING nova.compute.manager [req-c32bdb5c-29c5-421e-8876-fd32574333eb req-4f844948-f367-4722-8252-47317281a093 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state active and task_state rescuing.
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk 1073741824" returned: 0 in 0.076s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Successfully created port: 32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Cannot resize image /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Ensure instance console log exists: /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Successfully updated port: 32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquired lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-f693bf5d-d8b7-40e1-b2d0-5f3ee6690330 req-9a7290dc-9829-41ae-aa31-cf66f6424755 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received event network-changed-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-f693bf5d-d8b7-40e1-b2d0-5f3ee6690330 req-9a7290dc-9829-41ae-aa31-cf66f6424755 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Refreshing instance network info cache due to event network-changed-32d0feb4-7ca9-4529-a5fd-db95327b1bb0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f693bf5d-d8b7-40e1-b2d0-5f3ee6690330 req-9a7290dc-9829-41ae-aa31-cf66f6424755 service nova] Acquiring lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b277456f-6afa-4110-8a0a-ed353740d150 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating instance_info_cache with network_info: [{"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Releasing lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Instance network_info: |[{"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f693bf5d-d8b7-40e1-b2d0-5f3ee6690330 req-9a7290dc-9829-41ae-aa31-cf66f6424755 service nova] Acquired lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-f693bf5d-d8b7-40e1-b2d0-5f3ee6690330 req-9a7290dc-9829-41ae-aa31-cf66f6424755 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Refreshing network info cache for port 32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Start _get_guest_xml network_info=[{"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:02:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:02:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:02:23 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1400986693',display_name='tempest-SnapshotDataIntegrityTests-server-1400986693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1400986693',id=40,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNOPsVZUL7DraoVItxPks7RoTxCqYPfCfiSWFhVOmp3JHqwlqOHq1yzgWib3Gs0X0eXWdnMdRtPmcr8hqNeVxHHdOqSfP6RnviIsDFhrx4amGmISFYSVG9p+L4OjZaU8g==',key_name='tempest-keypair-1943678575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='665e8f7b1e514cd182ce6e1977e4a89a',ramdisk_id='',reservation_id='r-lse902ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1546553843',owner_user_name='tempest-SnapshotDataIntegrityTests-1546553843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca29852ee4b449c588d19457634538e1',uuid=e3e8acdb-747c-4b23-9a8b-70d7f0ce510f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Converting VIF {"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=32d0feb4-7ca9-4529-a5fd-db95327b1bb0,network=Network(79d7c8e1-73ef-462f-b122-fa53f1d4055b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d0feb4-7c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.objects.instance [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'pci_devices' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:02:24 user nova-compute[75288]:   <uuid>e3e8acdb-747c-4b23-9a8b-70d7f0ce510f</uuid>
Dec 01 14:02:24 user nova-compute[75288]:   <name>instance-00000028</name>
Dec 01 14:02:24 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:02:24 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:02:24 user nova-compute[75288]:   <metadata>
Dec 01 14:02:24 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:02:24 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:02:24 user nova-compute[75288]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1400986693</nova:name>
Dec 01 14:02:24 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:02:23</nova:creationTime>
Dec 01 14:02:24 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:02:24 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:02:24 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:02:24 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:02:24 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:02:24 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:02:24 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:02:24 user nova-compute[75288]:       <nova:owner>
Dec 01 14:02:24 user nova-compute[75288]:         <nova:user uuid="ca29852ee4b449c588d19457634538e1">tempest-SnapshotDataIntegrityTests-1546553843-project-member</nova:user>
Dec 01 14:02:24 user nova-compute[75288]:         <nova:project uuid="665e8f7b1e514cd182ce6e1977e4a89a">tempest-SnapshotDataIntegrityTests-1546553843</nova:project>
Dec 01 14:02:24 user nova-compute[75288]:       </nova:owner>
Dec 01 14:02:24 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:02:24 user nova-compute[75288]:       <nova:ports>
Dec 01 14:02:24 user nova-compute[75288]:         <nova:port uuid="32d0feb4-7ca9-4529-a5fd-db95327b1bb0">
Dec 01 14:02:24 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 14:02:24 user nova-compute[75288]:         </nova:port>
Dec 01 14:02:24 user nova-compute[75288]:       </nova:ports>
Dec 01 14:02:24 user nova-compute[75288]:     </nova:instance>
Dec 01 14:02:24 user nova-compute[75288]:   </metadata>
Dec 01 14:02:24 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:02:24 user nova-compute[75288]:     <system>
Dec 01 14:02:24 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:02:24 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:02:24 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:02:24 user nova-compute[75288]:       <entry name="serial">e3e8acdb-747c-4b23-9a8b-70d7f0ce510f</entry>
Dec 01 14:02:24 user nova-compute[75288]:       <entry name="uuid">e3e8acdb-747c-4b23-9a8b-70d7f0ce510f</entry>
Dec 01 14:02:24 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:02:24 user nova-compute[75288]:     </system>
Dec 01 14:02:24 user nova-compute[75288]:   </sysinfo>
Dec 01 14:02:24 user nova-compute[75288]:   <os>
Dec 01 14:02:24 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:02:24 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:02:24 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:02:24 user nova-compute[75288]:   </os>
Dec 01 14:02:24 user nova-compute[75288]:   <features>
Dec 01 14:02:24 user nova-compute[75288]:     <acpi/>
Dec 01 14:02:24 user nova-compute[75288]:     <apic/>
Dec 01 14:02:24 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:02:24 user nova-compute[75288]:   </features>
Dec 01 14:02:24 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:02:24 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:02:24 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:02:24 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:02:24 user nova-compute[75288]:   </clock>
Dec 01 14:02:24 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:02:24 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:02:24 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:02:24 user nova-compute[75288]:   </cpu>
Dec 01 14:02:24 user nova-compute[75288]:   <devices>
Dec 01 14:02:24 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:02:24 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:02:24 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk"/>
Dec 01 14:02:24 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:02:24 user nova-compute[75288]:     </disk>
Dec 01 14:02:24 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:02:24 user nova-compute[75288]:       <mac address="fa:16:3e:7c:b8:ac"/>
Dec 01 14:02:24 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:02:24 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:02:24 user nova-compute[75288]:       <target dev="tap32d0feb4-7c"/>
Dec 01 14:02:24 user nova-compute[75288]:     </interface>
Dec 01 14:02:24 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:02:24 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/console.log" append="off"/>
Dec 01 14:02:24 user nova-compute[75288]:     </serial>
Dec 01 14:02:24 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:02:24 user nova-compute[75288]:     <video>
Dec 01 14:02:24 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:02:24 user nova-compute[75288]:     </video>
Dec 01 14:02:24 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:02:24 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:02:24 user nova-compute[75288]:     </rng>
Dec 01 14:02:24 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:02:24 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:02:24 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:02:24 user nova-compute[75288]:     </memballoon>
Dec 01 14:02:24 user nova-compute[75288]:   </devices>
Dec 01 14:02:24 user nova-compute[75288]: </domain>
Dec 01 14:02:24 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1400986693',display_name='tempest-SnapshotDataIntegrityTests-server-1400986693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1400986693',id=40,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNOPsVZUL7DraoVItxPks7RoTxCqYPfCfiSWFhVOmp3JHqwlqOHq1yzgWib3Gs0X0eXWdnMdRtPmcr8hqNeVxHHdOqSfP6RnviIsDFhrx4amGmISFYSVG9p+L4OjZaU8g==',key_name='tempest-keypair-1943678575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='665e8f7b1e514cd182ce6e1977e4a89a',ramdisk_id='',reservation_id='r-lse902ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1546553843',owner_user_name='tempest-SnapshotDataIntegrityTests-1546553843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca29852ee4b449c588d19457634538e1',uuid=e3e8acdb-747c-4b23-9a8b-70d7f0ce510f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Converting VIF {"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=32d0feb4-7ca9-4529-a5fd-db95327b1bb0,network=Network(79d7c8e1-73ef-462f-b122-fa53f1d4055b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d0feb4-7c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG os_vif [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=32d0feb4-7ca9-4529-a5fd-db95327b1bb0,network=Network(79d7c8e1-73ef-462f-b122-fa53f1d4055b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d0feb4-7c') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cce3e775-c76a-556d-8f40-dfd2d33c9eba', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32d0feb4-7c, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32d0feb4-7c, col_values=(('qos', UUID('088c5de0-fb14-4f8a-b1bf-41375ec67a92')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32d0feb4-7c, col_values=(('external_ids', {'iface-id': '32d0feb4-7ca9-4529-a5fd-db95327b1bb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:b8:ac', 'vm-uuid': 'e3e8acdb-747c-4b23-9a8b-70d7f0ce510f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:24 user nova-compute[75288]: INFO os_vif [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=32d0feb4-7ca9-4529-a5fd-db95327b1bb0,network=Network(79d7c8e1-73ef-462f-b122-fa53f1d4055b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d0feb4-7c')
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No VIF found with MAC fa:16:3e:7c:b8:ac, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-f693bf5d-d8b7-40e1-b2d0-5f3ee6690330 req-9a7290dc-9829-41ae-aa31-cf66f6424755 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updated VIF entry in instance network info cache for port 32d0feb4-7ca9-4529-a5fd-db95327b1bb0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-f693bf5d-d8b7-40e1-b2d0-5f3ee6690330 req-9a7290dc-9829-41ae-aa31-cf66f6424755 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating instance_info_cache with network_info: [{"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f693bf5d-d8b7-40e1-b2d0-5f3ee6690330 req-9a7290dc-9829-41ae-aa31-cf66f6424755 service nova] Releasing lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:02:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-5bec4c76-42c6-4fc1-b57e-d2989d36fccd req-5a8c28af-8c14-4697-ad4c-22fc2300d046 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received event network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bec4c76-42c6-4fc1-b57e-d2989d36fccd req-5a8c28af-8c14-4697-ad4c-22fc2300d046 service nova] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bec4c76-42c6-4fc1-b57e-d2989d36fccd req-5a8c28af-8c14-4697-ad4c-22fc2300d046 service nova] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5bec4c76-42c6-4fc1-b57e-d2989d36fccd req-5a8c28af-8c14-4697-ad4c-22fc2300d046 service nova] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:25 user nova-compute[75288]: DEBUG nova.compute.manager [req-5bec4c76-42c6-4fc1-b57e-d2989d36fccd req-5a8c28af-8c14-4697-ad4c-22fc2300d046 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] No waiting events found dispatching network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:25 user nova-compute[75288]: WARNING nova.compute.manager [req-5bec4c76-42c6-4fc1-b57e-d2989d36fccd req-5a8c28af-8c14-4697-ad4c-22fc2300d046 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received unexpected event network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 for instance with vm_state building and task_state spawning.
Dec 01 14:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:02:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Instance spawned successfully.
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-87ebad72-96be-4735-8879-c65b5a65187e req-893e1861-4d2c-48e5-ad7f-6547fa1e2ad1 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received event network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-87ebad72-96be-4735-8879-c65b5a65187e req-893e1861-4d2c-48e5-ad7f-6547fa1e2ad1 service nova] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-87ebad72-96be-4735-8879-c65b5a65187e req-893e1861-4d2c-48e5-ad7f-6547fa1e2ad1 service nova] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-87ebad72-96be-4735-8879-c65b5a65187e req-893e1861-4d2c-48e5-ad7f-6547fa1e2ad1 service nova] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-87ebad72-96be-4735-8879-c65b5a65187e req-893e1861-4d2c-48e5-ad7f-6547fa1e2ad1 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] No waiting events found dispatching network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:27 user nova-compute[75288]: WARNING nova.compute.manager [req-87ebad72-96be-4735-8879-c65b5a65187e req-893e1861-4d2c-48e5-ad7f-6547fa1e2ad1 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received unexpected event network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 for instance with vm_state building and task_state spawning.
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:02:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:02:28 user nova-compute[75288]: INFO nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Took 5.95 seconds to spawn the instance on the hypervisor.
Dec 01 14:02:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:02:28 user nova-compute[75288]: INFO nova.compute.manager [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Took 6.88 seconds to build instance.
Dec 01 14:02:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-76814474-0245-49f3-8338-cf71ad1ea174 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.992s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a5a31625-17b4-4a41-9914-17f3174cc158 req-994f2f7e-59a9-420e-ad16-3eb4640677fc service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-changed-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-a5a31625-17b4-4a41-9914-17f3174cc158 req-994f2f7e-59a9-420e-ad16-3eb4640677fc service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Refreshing instance network info cache due to event network-changed-ef8189f5-33cb-4afa-9d8b-2890e86c9e28. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:02:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a5a31625-17b4-4a41-9914-17f3174cc158 req-994f2f7e-59a9-420e-ad16-3eb4640677fc service nova] Acquiring lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:02:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a5a31625-17b4-4a41-9914-17f3174cc158 req-994f2f7e-59a9-420e-ad16-3eb4640677fc service nova] Acquired lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:02:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-a5a31625-17b4-4a41-9914-17f3174cc158 req-994f2f7e-59a9-420e-ad16-3eb4640677fc service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Refreshing network info cache for port ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:02:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-a5a31625-17b4-4a41-9914-17f3174cc158 req-994f2f7e-59a9-420e-ad16-3eb4640677fc service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updated VIF entry in instance network info cache for port ef8189f5-33cb-4afa-9d8b-2890e86c9e28. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:02:36 user nova-compute[75288]: DEBUG nova.network.neutron [req-a5a31625-17b4-4a41-9914-17f3174cc158 req-994f2f7e-59a9-420e-ad16-3eb4640677fc service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a5a31625-17b4-4a41-9914-17f3174cc158 req-994f2f7e-59a9-420e-ad16-3eb4640677fc service nova] Releasing lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:02:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:39 user nova-compute[75288]: INFO nova.compute.manager [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Attaching volume 849575bf-c6fa-4ad5-9c53-14e4823b64bb to /dev/vdb
Dec 01 14:02:39 user nova-compute[75288]: DEBUG os_brick.utils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[231b75e1-d14d-4b44-98b6-5aeaa6e8152c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61bd06-2293-47fc-92a9-a1ad59547c58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aa279f-1b8c-42dc-ad28-0effb9af61b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b84a19-65ac-401d-b302-dda07a295049]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:02:39 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:02:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baf2f66-dab8-40ed-b3d2-35537da848d1]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG os_brick.utils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:02:39 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating existing volume attachment record: 59e06cca-4b6d-4382-a054-9828f5a5c7e4 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:02:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARBrkwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:02:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:02:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:02:49 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57df27a-2ffb-4be2-a9c6-3ce28a846a90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:02:49 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a605960-a71c-40c0-ba61-a007bd2372fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb] added
Dec 01 14:02:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c66284-7013-43bf-8212-3096e7955330]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d15859b-28ce-4a94-a304-b0af0b7adb0d]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MARBrkwL {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MARBrkwL" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b88ace-f71b-4a2a-99a3-b49126729faa]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MARBrkwL'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09d9db-9e21-40e6-a371-f86ae1627bce]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b915261f-a480-46ad-9eec-a7a224210eda]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47dd856c-7e68-4cc1-89ac-0990dc308b56 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47dd856c-7e68-4cc1-89ac-0990dc308b56 (non-flash)
Dec 01 14:02:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47dd856c-7e68-4cc1-89ac-0990dc308b56 (non-flash)
Dec 01 14:02:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[750be9a1-b7b2-44c8-807a-4f84bb466644]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260]
Dec 01 14:02:49 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260] successful.
Dec 01 14:02:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3eaa66-b10f-425a-9605-47d9a9a7d79d]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f345f098-feb8-4905-848f-75e1e5dc7a27]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47dd856c-7e68-4cc1-89ac-0990dc308b56 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47dd856c-7e68-4cc1-89ac-0990dc308b56 (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:02:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47dd856c-7e68-4cc1-89ac-0990dc308b56 (non-flash)
Dec 01 14:02:49 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:02:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6d111e-7450-4026-83f2-b43a645dc5d3]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:02:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARBrkwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26662623337356534', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662623337356534', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:02:50 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:02:50 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 14:02:50 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:02:50 user nova-compute[75288]:   <serial>849575bf-c6fa-4ad5-9c53-14e4823b64bb</serial>
Dec 01 14:02:50 user nova-compute[75288]: </disk>
Dec 01 14:02:50 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-26a19897-970a-4537-89c6-7aff0a2fc008 req-f5dadd24-387b-43ec-b0a6-719e62278451 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-changed-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-26a19897-970a-4537-89c6-7aff0a2fc008 req-f5dadd24-387b-43ec-b0a6-719e62278451 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Refreshing instance network info cache due to event network-changed-84c070b9-aa68-466b-adc9-dc6f190937a2. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26a19897-970a-4537-89c6-7aff0a2fc008 req-f5dadd24-387b-43ec-b0a6-719e62278451 service nova] Acquiring lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26a19897-970a-4537-89c6-7aff0a2fc008 req-f5dadd24-387b-43ec-b0a6-719e62278451 service nova] Acquired lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-26a19897-970a-4537-89c6-7aff0a2fc008 req-f5dadd24-387b-43ec-b0a6-719e62278451 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Refreshing network info cache for port 84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:02:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No VIF found with MAC fa:16:3e:18:bf:e4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ea99f33f-c79c-49dc-b8e4-f0ea86fcd45f tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.289s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-26a19897-970a-4537-89c6-7aff0a2fc008 req-f5dadd24-387b-43ec-b0a6-719e62278451 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updated VIF entry in instance network info cache for port 84c070b9-aa68-466b-adc9-dc6f190937a2. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-26a19897-970a-4537-89c6-7aff0a2fc008 req-f5dadd24-387b-43ec-b0a6-719e62278451 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating instance_info_cache with network_info: [{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-26a19897-970a-4537-89c6-7aff0a2fc008 req-f5dadd24-387b-43ec-b0a6-719e62278451 service nova] Releasing lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a20644b2-f92e-495f-93f0-608d9c780617 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a20644b2-f92e-495f-93f0-608d9c780617 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a20644b2-f92e-495f-93f0-608d9c780617 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a20644b2-f92e-495f-93f0-608d9c780617 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75288) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a20644b2-f92e-495f-93f0-608d9c780617 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-ecff00ad-b5ba-453c-b0e2-7f52bd4b82b5 req-6ee0ec85-1ca4-4af2-96d6-ae97c5f3c1ec service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ecff00ad-b5ba-453c-b0e2-7f52bd4b82b5 req-6ee0ec85-1ca4-4af2-96d6-ae97c5f3c1ec service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ecff00ad-b5ba-453c-b0e2-7f52bd4b82b5 req-6ee0ec85-1ca4-4af2-96d6-ae97c5f3c1ec service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ecff00ad-b5ba-453c-b0e2-7f52bd4b82b5 req-6ee0ec85-1ca4-4af2-96d6-ae97c5f3c1ec service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-ecff00ad-b5ba-453c-b0e2-7f52bd4b82b5 req-6ee0ec85-1ca4-4af2-96d6-ae97c5f3c1ec service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:52 user nova-compute[75288]: WARNING nova.compute.manager [req-ecff00ad-b5ba-453c-b0e2-7f52bd4b82b5 req-6ee0ec85-1ca4-4af2-96d6-ae97c5f3c1ec service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state active and task_state powering-off.
Dec 01 14:02:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance destroyed successfully.
Dec 01 14:02:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a20644b2-f92e-495f-93f0-608d9c780617 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a20644b2-f92e-495f-93f0-608d9c780617 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.893s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b49c0d3-10ea-4bec-987e-bc3fbc56e0c9 req-85ed9453-6e26-4524-bb1b-61c51b82398a service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b49c0d3-10ea-4bec-987e-bc3fbc56e0c9 req-85ed9453-6e26-4524-bb1b-61c51b82398a service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b49c0d3-10ea-4bec-987e-bc3fbc56e0c9 req-85ed9453-6e26-4524-bb1b-61c51b82398a service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0b49c0d3-10ea-4bec-987e-bc3fbc56e0c9 req-85ed9453-6e26-4524-bb1b-61c51b82398a service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-0b49c0d3-10ea-4bec-987e-bc3fbc56e0c9 req-85ed9453-6e26-4524-bb1b-61c51b82398a service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:54 user nova-compute[75288]: WARNING nova.compute.manager [req-0b49c0d3-10ea-4bec-987e-bc3fbc56e0c9 req-85ed9453-6e26-4524-bb1b-61c51b82398a service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state stopped and task_state None.
Dec 01 14:02:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:54 user nova-compute[75288]: INFO nova.compute.manager [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Shelving
Dec 01 14:02:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance destroyed successfully.
Dec 01 14:02:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Beginning cold snapshot process
Dec 01 14:02:55 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 14:02:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk /opt/stack/data/nova/instances/snapshots/tmpfvoh2cob/52f0d721ce72459dbf7764f09cb21eff {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-unplugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] No waiting events found dispatching network-vif-unplugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:56 user nova-compute[75288]: WARNING nova.compute.manager [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received unexpected event network-vif-unplugged-84c070b9-aa68-466b-adc9-dc6f190937a2 for instance with vm_state active and task_state shelving_image_pending_upload.
Dec 01 14:02:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:02:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] No waiting events found dispatching network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:02:56 user nova-compute[75288]: WARNING nova.compute.manager [req-4b8fed56-b24f-43cd-8c7b-54dcf7146226 req-132cf5d1-b20d-4495-82f8-abb48c95b8b1 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received unexpected event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 for instance with vm_state active and task_state shelving_image_pending_upload.
Dec 01 14:02:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk /opt/stack/data/nova/instances/snapshots/tmpfvoh2cob/52f0d721ce72459dbf7764f09cb21eff" returned: 0 in 0.895s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:02:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Snapshot extracted, beginning image upload
Dec 01 14:02:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:02:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Snapshot image upload complete
Dec 01 14:02:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:02:59 user nova-compute[75288]: INFO nova.compute.manager [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Shelve offloading
Dec 01 14:02:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance destroyed successfully.
Dec 01 14:02:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:02:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:02:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquired lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:02:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:02:59 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating instance_info_cache with network_info: [{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:02:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Releasing lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:03:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance destroyed successfully.
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'resources' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2061549974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2061549974',id=39,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLGZoVn8wo0j+HxWvdZGonHfTRdvBPEtxiw/UmPhkHaSaiKgn4cKu/pEbtMUPTDSXF0UFybWDDxrt/bhvYTH/kmRQDBt0bxFDQBvzI3cxxc/MM2LRFwALn05z402ouZnQ==',key_name='tempest-keypair-1949436941',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-5toak1n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member',shelved_at='2023-12-01T14:02:59.174328',shelved_host='user',shelved_image_id='275ba717-217d-4fc2-b778-67e551544703'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=9ae651bf-c461-46e1-bc89-182740d6fe04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG os_vif [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c070b9-aa, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-1c952c36-28cb-4f9f-8697-22b5b08c4929 req-768d67d4-c9f9-47a2-9683-7eef661cd82a service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-changed-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-1c952c36-28cb-4f9f-8697-22b5b08c4929 req-768d67d4-c9f9-47a2-9683-7eef661cd82a service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Refreshing instance network info cache due to event network-changed-84c070b9-aa68-466b-adc9-dc6f190937a2. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1c952c36-28cb-4f9f-8697-22b5b08c4929 req-768d67d4-c9f9-47a2-9683-7eef661cd82a service nova] Acquiring lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1c952c36-28cb-4f9f-8697-22b5b08c4929 req-768d67d4-c9f9-47a2-9683-7eef661cd82a service nova] Acquired lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-1c952c36-28cb-4f9f-8697-22b5b08c4929 req-768d67d4-c9f9-47a2-9683-7eef661cd82a service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Refreshing network info cache for port 84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4534f16d-cf43-43c8-931f-b95c8f7527f4) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:00 user nova-compute[75288]: INFO os_vif [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa')
Dec 01 14:03:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Deleting instance files /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04_del
Dec 01 14:03:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Deletion of /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04_del complete
Dec 01 14:03:00 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Deleted allocations for instance 9ae651bf-c461-46e1-bc89-182740d6fe04
Dec 01 14:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.objects.base [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<9ae651bf-c461-46e1-bc89-182740d6fe04> lazy-loaded attributes: resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-1c952c36-28cb-4f9f-8697-22b5b08c4929 req-768d67d4-c9f9-47a2-9683-7eef661cd82a service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updated VIF entry in instance network info cache for port 84c070b9-aa68-466b-adc9-dc6f190937a2. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG nova.network.neutron [req-1c952c36-28cb-4f9f-8697-22b5b08c4929 req-768d67d4-c9f9-47a2-9683-7eef661cd82a service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating instance_info_cache with network_info: [{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap84c070b9-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1c952c36-28cb-4f9f-8697-22b5b08c4929 req-768d67d4-c9f9-47a2-9683-7eef661cd82a service nova] Releasing lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ba32b4dc-d208-45b2-9dd5-cb28921219f0 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.442s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:15 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:03:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:03:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:03:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:03:16 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:03:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 876c78f2-a975-49ea-9f97-cdca86cc1c51 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:03:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updating instance_info_cache with network_info: [{"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.rescue --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:03:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=24.894012451171875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 28c7d2bd-7c14-4dbd-a798-48eb6546c51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:03:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:03:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:03:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:03:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:03:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:03:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:03:29 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:03:29 user nova-compute[75288]: INFO nova.compute.claims [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Claim successful on node user
Dec 01 14:03:30 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:03:30 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:03:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:03:30 user nova-compute[75288]: INFO nova.virt.block_device [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Booting with volume 469e7cb7-71e7-499d-b092-6c9182578f0d at /dev/vda
Dec 01 14:03:30 user nova-compute[75288]: DEBUG nova.policy [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c3fc71e453145b3bba513c6bed1db09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538347059fc54fb9a5da690fa138daae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG os_brick.utils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a25ac47-3fd0-44c9-a29b-874d0039ad0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd3bd0a-b119-4840-8f62-8da75085a796]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[94536799-78c9-4ec4-aeda-5134b64c4eb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c1e0aa-2791-40c3-8da0-b14a799cca60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:03:30 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:03:30 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a96edd0-2380-4ad4-924e-ee7aa6d64909]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG os_brick.utils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:03:30 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updating existing volume attachment record: ea4225dc-60d6-4023-a980-c2d7f8e904da {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:03:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Successfully created port: 13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Successfully updated port: 13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquired lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-a73a9808-2fc9-461b-9386-6a898773e348 req-3fdc4ed3-31f0-4e3c-8882-c25b62e876b3 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-changed-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-a73a9808-2fc9-461b-9386-6a898773e348 req-3fdc4ed3-31f0-4e3c-8882-c25b62e876b3 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Refreshing instance network info cache due to event network-changed-13c76a3f-58ea-4c3e-a668-d0951601b610. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a73a9808-2fc9-461b-9386-6a898773e348 req-3fdc4ed3-31f0-4e3c-8882-c25b62e876b3 service nova] Acquiring lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updating instance_info_cache with network_info: [{"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Releasing lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance network_info: |[{"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a73a9808-2fc9-461b-9386-6a898773e348 req-3fdc4ed3-31f0-4e3c-8882-c25b62e876b3 service nova] Acquired lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-a73a9808-2fc9-461b-9386-6a898773e348 req-3fdc4ed3-31f0-4e3c-8882-c25b62e876b3 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Refreshing network info cache for port 13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-a73a9808-2fc9-461b-9386-6a898773e348 req-3fdc4ed3-31f0-4e3c-8882-c25b62e876b3 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updated VIF entry in instance network info cache for port 13c76a3f-58ea-4c3e-a668-d0951601b610. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG nova.network.neutron [req-a73a9808-2fc9-461b-9386-6a898773e348 req-3fdc4ed3-31f0-4e3c-8882-c25b62e876b3 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updating instance_info_cache with network_info: [{"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:03:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a73a9808-2fc9-461b-9386-6a898773e348 req-3fdc4ed3-31f0-4e3c-8882-c25b62e876b3 service nova] Releasing lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:03:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:03:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:03:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Creating image(s)
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Ensure instance console log exists: /opt/stack/data/nova/instances/4be22849-cc7f-4d2c-a164-64b5f9e209f8/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Start _get_guest_xml network_info=[{"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ea4225dc-60d6-4023-a980-c2d7f8e904da', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4be22849-cc7f-4d2c-a164-64b5f9e209f8', 'attached_at': '', 'detached_at': '', 'volume_id': '469e7cb7-71e7-499d-b092-6c9182578f0d', 'serial': '469e7cb7-71e7-499d-b092-6c9182578f0d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:03:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:03:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:03:39 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:03:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:03:40 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:03:40 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8152d33-10f9-4639-b217-23c6524acd2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:03:40 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a165f76-75ee-4a9c-96e4-804beea1d3fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d] added
Dec 01 14:03:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96738f5-7381-4083-aa4d-b1f0ebde37ab]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e96182-a2a9-487a-8c31-8da71e502554]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhSHQaWp {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhSHQaWp" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2daa67e-fbc8-4e15-8bf1-9e3766dac76b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vhSHQaWp'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be193a6-33dc-4781-bedc-b2f85488a67b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4687f79-a42c-425f-b4b0-63a42011769d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:03:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:03:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53512cb-0891-4241-9fea-9030beb6e7fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260]
Dec 01 14:03:40 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260] successful.
Dec 01 14:03:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e7e712-dc86-4f88-8a79-feaf12abaee2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1160b7-40d9-461a-9c0c-df276c7f4c2c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:03:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:03:40 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:03:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[27acacc7-d1ae-4e0a-ac51-38262c92cc4f]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:03:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26635393438393965', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635393438393965', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1482792749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1482792749',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc7FfvG1tx1bhwWaV0yEVXohOMyaxsQiapAzm0VI2IldJ/xYPeLxsqGNLjT+nDVD7q/i7w42TB7DdWiOaxUi1lxBE/jXsx6YaiFWJlQOTRIY16v61SJk+LkCAuS6vCezQ==',key_name='tempest-keypair-1123464944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='538347059fc54fb9a5da690fa138daae',ramdisk_id='',reservation_id='r-s1m2c1jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-491583892',owner_user_name='tempest-ServerActionsV293TestJSON-491583892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3fc71e453145b3bba513c6bed1db09',uuid=4be22849-cc7f-4d2c-a164-64b5f9e209f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converting VIF {"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lazy-loading 'pci_devices' on Instance uuid 4be22849-cc7f-4d2c-a164-64b5f9e209f8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:03:41 user nova-compute[75288]:   <uuid>4be22849-cc7f-4d2c-a164-64b5f9e209f8</uuid>
Dec 01 14:03:41 user nova-compute[75288]:   <name>instance-00000029</name>
Dec 01 14:03:41 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:03:41 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:03:41 user nova-compute[75288]:   <metadata>
Dec 01 14:03:41 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:03:41 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:03:41 user nova-compute[75288]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1482792749</nova:name>
Dec 01 14:03:41 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:03:39</nova:creationTime>
Dec 01 14:03:41 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:03:41 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:03:41 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:03:41 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:03:41 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:03:41 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:03:41 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:03:41 user nova-compute[75288]:       <nova:owner>
Dec 01 14:03:41 user nova-compute[75288]:         <nova:user uuid="4c3fc71e453145b3bba513c6bed1db09">tempest-ServerActionsV293TestJSON-491583892-project-member</nova:user>
Dec 01 14:03:41 user nova-compute[75288]:         <nova:project uuid="538347059fc54fb9a5da690fa138daae">tempest-ServerActionsV293TestJSON-491583892</nova:project>
Dec 01 14:03:41 user nova-compute[75288]:       </nova:owner>
Dec 01 14:03:41 user nova-compute[75288]:       <nova:ports>
Dec 01 14:03:41 user nova-compute[75288]:         <nova:port uuid="13c76a3f-58ea-4c3e-a668-d0951601b610">
Dec 01 14:03:41 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 14:03:41 user nova-compute[75288]:         </nova:port>
Dec 01 14:03:41 user nova-compute[75288]:       </nova:ports>
Dec 01 14:03:41 user nova-compute[75288]:     </nova:instance>
Dec 01 14:03:41 user nova-compute[75288]:   </metadata>
Dec 01 14:03:41 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:03:41 user nova-compute[75288]:     <system>
Dec 01 14:03:41 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:03:41 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:03:41 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:03:41 user nova-compute[75288]:       <entry name="serial">4be22849-cc7f-4d2c-a164-64b5f9e209f8</entry>
Dec 01 14:03:41 user nova-compute[75288]:       <entry name="uuid">4be22849-cc7f-4d2c-a164-64b5f9e209f8</entry>
Dec 01 14:03:41 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:03:41 user nova-compute[75288]:     </system>
Dec 01 14:03:41 user nova-compute[75288]:   </sysinfo>
Dec 01 14:03:41 user nova-compute[75288]:   <os>
Dec 01 14:03:41 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:03:41 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:03:41 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:03:41 user nova-compute[75288]:   </os>
Dec 01 14:03:41 user nova-compute[75288]:   <features>
Dec 01 14:03:41 user nova-compute[75288]:     <acpi/>
Dec 01 14:03:41 user nova-compute[75288]:     <apic/>
Dec 01 14:03:41 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:03:41 user nova-compute[75288]:   </features>
Dec 01 14:03:41 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:03:41 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:03:41 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:03:41 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:03:41 user nova-compute[75288]:   </clock>
Dec 01 14:03:41 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:03:41 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:03:41 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:03:41 user nova-compute[75288]:   </cpu>
Dec 01 14:03:41 user nova-compute[75288]:   <devices>
Dec 01 14:03:41 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 14:03:41 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:03:41 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Dec 01 14:03:41 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:03:41 user nova-compute[75288]:       <serial>469e7cb7-71e7-499d-b092-6c9182578f0d</serial>
Dec 01 14:03:41 user nova-compute[75288]:     </disk>
Dec 01 14:03:41 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:03:41 user nova-compute[75288]:       <mac address="fa:16:3e:48:ba:8c"/>
Dec 01 14:03:41 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:03:41 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:03:41 user nova-compute[75288]:       <target dev="tap13c76a3f-58"/>
Dec 01 14:03:41 user nova-compute[75288]:     </interface>
Dec 01 14:03:41 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:03:41 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/4be22849-cc7f-4d2c-a164-64b5f9e209f8/console.log" append="off"/>
Dec 01 14:03:41 user nova-compute[75288]:     </serial>
Dec 01 14:03:41 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:03:41 user nova-compute[75288]:     <video>
Dec 01 14:03:41 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:03:41 user nova-compute[75288]:     </video>
Dec 01 14:03:41 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:03:41 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:03:41 user nova-compute[75288]:     </rng>
Dec 01 14:03:41 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:03:41 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:03:41 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:03:41 user nova-compute[75288]:     </memballoon>
Dec 01 14:03:41 user nova-compute[75288]:   </devices>
Dec 01 14:03:41 user nova-compute[75288]: </domain>
Dec 01 14:03:41 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1482792749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1482792749',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc7FfvG1tx1bhwWaV0yEVXohOMyaxsQiapAzm0VI2IldJ/xYPeLxsqGNLjT+nDVD7q/i7w42TB7DdWiOaxUi1lxBE/jXsx6YaiFWJlQOTRIY16v61SJk+LkCAuS6vCezQ==',key_name='tempest-keypair-1123464944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='538347059fc54fb9a5da690fa138daae',ramdisk_id='',reservation_id='r-s1m2c1jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-491583892',owner_user_name='tempest-ServerActionsV293TestJSON-491583892-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3fc71e453145b3bba513c6bed1db09',uuid=4be22849-cc7f-4d2c-a164-64b5f9e209f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converting VIF {"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG os_vif [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9275c7b8-d6b6-52f7-8a34-365ca0306703', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13c76a3f-58, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13c76a3f-58, col_values=(('qos', UUID('0d63e1c4-4369-4e01-98ae-9c1b59332a03')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13c76a3f-58, col_values=(('external_ids', {'iface-id': '13c76a3f-58ea-4c3e-a668-d0951601b610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:ba:8c', 'vm-uuid': '4be22849-cc7f-4d2c-a164-64b5f9e209f8'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:41 user nova-compute[75288]: INFO os_vif [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58')
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:03:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] No VIF found with MAC fa:16:3e:48:ba:8c, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-50185f0e-eb93-4d5e-b517-92da642510bd req-003718f8-c8bd-4d22-b9d3-abfedd062b64 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-50185f0e-eb93-4d5e-b517-92da642510bd req-003718f8-c8bd-4d22-b9d3-abfedd062b64 service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-50185f0e-eb93-4d5e-b517-92da642510bd req-003718f8-c8bd-4d22-b9d3-abfedd062b64 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-50185f0e-eb93-4d5e-b517-92da642510bd req-003718f8-c8bd-4d22-b9d3-abfedd062b64 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-50185f0e-eb93-4d5e-b517-92da642510bd req-003718f8-c8bd-4d22-b9d3-abfedd062b64 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] No waiting events found dispatching network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:03:42 user nova-compute[75288]: WARNING nova.compute.manager [req-50185f0e-eb93-4d5e-b517-92da642510bd req-003718f8-c8bd-4d22-b9d3-abfedd062b64 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received unexpected event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 for instance with vm_state building and task_state spawning.
Dec 01 14:03:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:03:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance spawned successfully.
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:03:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:03:45 user nova-compute[75288]: INFO nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Took 5.11 seconds to spawn the instance on the hypervisor.
Dec 01 14:03:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:03:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-5021a791-9812-4308-86ae-b7b1788128f4 req-85515e90-818c-4c68-8157-f572f56e1ebd service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:03:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5021a791-9812-4308-86ae-b7b1788128f4 req-85515e90-818c-4c68-8157-f572f56e1ebd service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:03:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5021a791-9812-4308-86ae-b7b1788128f4 req-85515e90-818c-4c68-8157-f572f56e1ebd service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:03:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5021a791-9812-4308-86ae-b7b1788128f4 req-85515e90-818c-4c68-8157-f572f56e1ebd service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-5021a791-9812-4308-86ae-b7b1788128f4 req-85515e90-818c-4c68-8157-f572f56e1ebd service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] No waiting events found dispatching network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:03:45 user nova-compute[75288]: WARNING nova.compute.manager [req-5021a791-9812-4308-86ae-b7b1788128f4 req-85515e90-818c-4c68-8157-f572f56e1ebd service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received unexpected event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 for instance with vm_state building and task_state spawning.
Dec 01 14:03:45 user nova-compute[75288]: INFO nova.compute.manager [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Took 15.31 seconds to build instance.
Dec 01 14:03:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-3be52aa9-1179-44a4-a99d-a46456e0b330 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.403s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:03:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:03:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:04:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:05 user nova-compute[75288]: INFO nova.compute.manager [None req-0317b107-ee24-410e-9745-e2a1db9b5219 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Unrescuing
Dec 01 14:04:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0317b107-ee24-410e-9745-e2a1db9b5219 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:04:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0317b107-ee24-410e-9745-e2a1db9b5219 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquired lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:04:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-0317b107-ee24-410e-9745-e2a1db9b5219 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-0317b107-ee24-410e-9745-e2a1db9b5219 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Updating instance_info_cache with network_info: [{"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0317b107-ee24-410e-9745-e2a1db9b5219 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Releasing lock "refresh_cache-28c7d2bd-7c14-4dbd-a798-48eb6546c51c" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG nova.objects.instance [None req-0317b107-ee24-410e-9745-e2a1db9b5219 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'flavor' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-d7402c65-adfd-4b77-a597-3f04271ef9fc req-a849cb41-9af5-4488-95f5-12e07b820123 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d7402c65-adfd-4b77-a597-3f04271ef9fc req-a849cb41-9af5-4488-95f5-12e07b820123 service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d7402c65-adfd-4b77-a597-3f04271ef9fc req-a849cb41-9af5-4488-95f5-12e07b820123 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d7402c65-adfd-4b77-a597-3f04271ef9fc req-a849cb41-9af5-4488-95f5-12e07b820123 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG nova.compute.manager [req-d7402c65-adfd-4b77-a597-3f04271ef9fc req-a849cb41-9af5-4488-95f5-12e07b820123 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:04:06 user nova-compute[75288]: WARNING nova.compute.manager [req-d7402c65-adfd-4b77-a597-3f04271ef9fc req-a849cb41-9af5-4488-95f5-12e07b820123 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state rescued and task_state unrescuing.
Dec 01 14:04:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance destroyed successfully.
Dec 01 14:04:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:04:08 user nova-compute[75288]: WARNING nova.compute.manager [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state rescued and task_state unrescuing.
Dec 01 14:04:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:04:08 user nova-compute[75288]: WARNING nova.compute.manager [req-8e7386df-45c4-4a05-aaf7-4efff9f9a66d req-9542b158-358c-4131-a300-6914ae7b6e29 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state rescued and task_state unrescuing.
Dec 01 14:04:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:10 user nova-compute[75288]: DEBUG nova.compute.manager [None req-0317b107-ee24-410e-9745-e2a1db9b5219 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:04:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-60a1d18c-7a66-4fae-94a9-1115958f2f7c req-e3693ede-fc0b-4e48-87a8-297bbd25d21f service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60a1d18c-7a66-4fae-94a9-1115958f2f7c req-e3693ede-fc0b-4e48-87a8-297bbd25d21f service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60a1d18c-7a66-4fae-94a9-1115958f2f7c req-e3693ede-fc0b-4e48-87a8-297bbd25d21f service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-60a1d18c-7a66-4fae-94a9-1115958f2f7c req-e3693ede-fc0b-4e48-87a8-297bbd25d21f service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:10 user nova-compute[75288]: DEBUG nova.compute.manager [req-60a1d18c-7a66-4fae-94a9-1115958f2f7c req-e3693ede-fc0b-4e48-87a8-297bbd25d21f service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:04:10 user nova-compute[75288]: WARNING nova.compute.manager [req-60a1d18c-7a66-4fae-94a9-1115958f2f7c req-e3693ede-fc0b-4e48-87a8-297bbd25d21f service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state active and task_state None.
Dec 01 14:04:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-c038cba0-7274-447b-ac6c-0be22d4fca34 req-feaecd0a-7690-4467-9c39-c49b66c920c7 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received event network-changed-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:12 user nova-compute[75288]: DEBUG nova.compute.manager [req-c038cba0-7274-447b-ac6c-0be22d4fca34 req-feaecd0a-7690-4467-9c39-c49b66c920c7 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Refreshing instance network info cache due to event network-changed-32d0feb4-7ca9-4529-a5fd-db95327b1bb0. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:04:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c038cba0-7274-447b-ac6c-0be22d4fca34 req-feaecd0a-7690-4467-9c39-c49b66c920c7 service nova] Acquiring lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:04:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c038cba0-7274-447b-ac6c-0be22d4fca34 req-feaecd0a-7690-4467-9c39-c49b66c920c7 service nova] Acquired lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:04:12 user nova-compute[75288]: DEBUG nova.network.neutron [req-c038cba0-7274-447b-ac6c-0be22d4fca34 req-feaecd0a-7690-4467-9c39-c49b66c920c7 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Refreshing network info cache for port 32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:04:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-c038cba0-7274-447b-ac6c-0be22d4fca34 req-feaecd0a-7690-4467-9c39-c49b66c920c7 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updated VIF entry in instance network info cache for port 32d0feb4-7ca9-4529-a5fd-db95327b1bb0. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:04:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-c038cba0-7274-447b-ac6c-0be22d4fca34 req-feaecd0a-7690-4467-9c39-c49b66c920c7 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating instance_info_cache with network_info: [{"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:04:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c038cba0-7274-447b-ac6c-0be22d4fca34 req-feaecd0a-7690-4467-9c39-c49b66c920c7 service nova] Releasing lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:04:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:16 user nova-compute[75288]: INFO nova.compute.manager [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attaching volume 93d2e92c-dd18-4a5c-a881-98fec28a242b to /dev/vdb
Dec 01 14:04:17 user nova-compute[75288]: DEBUG os_brick.utils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9175d-b1ff-43d2-919a-1281d381d48f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bf2505-15b2-4f3e-ba55-e813612d1f7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[36319413-df05-4672-82c0-bba18e65b8ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12fdcb4-c132-450a-9d1b-1bb8c5493305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:04:17 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b5128-7f55-4d41-991a-45f47312c26e]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG os_brick.utils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating existing volume attachment record: c697b14a-a7e4-4add-b423-2053c02655f9 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updating instance_info_cache with network_info: [{"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-e38d99ed-efd9-4222-aaae-b06934bfac06" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:21 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:04:21 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8289MB free_disk=24.884124755859375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 28c7d2bd-7c14-4dbd-a798-48eb6546c51c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 4be22849-cc7f-4d2c-a164-64b5f9e209f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:04:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:04:22 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:04:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:04:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCJejxUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:04:27 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:04:27 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:04:27 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eef4f4-4494-415e-a286-6a911007463e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:04:27 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cf8f60-51ce-4387-ac87-a029647302a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b] added
Dec 01 14:04:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7f0f94-dca9-4daa-8880-348427cd8da0]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[787bf93c-cc0f-4f63-a45b-d5685e26d530]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCJejxUA {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RCJejxUA" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b90df-387c-4600-9c63-f59187937e67]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RCJejxUA'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c9501e-05d5-4f41-85ea-bf6d605a5213]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e42a98-97e4-4b07-aad2-84f9ff87a277]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e762653-b89b-4bcc-bee6-bf314f701e0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b, portal: 172.16.0.220,3260]
Dec 01 14:04:27 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b, portal: 172.16.0.220,3260] successful.
Dec 01 14:04:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1cf963-1246-4dd3-a416-ef2baa0c0d08]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[babea014-a1d0-4e6b-b8d5-ff3ed96b0f14]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:04:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:27 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:04:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90eb817-79f1-4be9-ac4d-c9d2d828c74b]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCJejxUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:04:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:04:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23930373166316538', 'path': '/dev/sdf'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:04:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930373166316538', 'path': '/dev/sdf'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:04:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:04:28 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:04:28 user nova-compute[75288]:   <source dev="/dev/sdf"/>
Dec 01 14:04:28 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:04:28 user nova-compute[75288]:   <serial>93d2e92c-dd18-4a5c-a881-98fec28a242b</serial>
Dec 01 14:04:28 user nova-compute[75288]: </disk>
Dec 01 14:04:28 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:04:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:04:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:04:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No VIF found with MAC fa:16:3e:7c:b8:ac, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:04:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-415c5db7-49af-4730-8fdc-6dbb71b84349 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.152s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:04:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 14:04:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 14:04:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance has had 4 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Dec 01 14:04:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Deletion of /opt/stack/data/nova/instances/2c66ff7f-d0d9-43ff-98a4-bb702780e080_resize failed
Dec 01 14:04:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:42 user nova-compute[75288]: DEBUG nova.objects.instance [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:04:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquired lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:04:42 user nova-compute[75288]: DEBUG nova.network.neutron [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:04:42 user nova-compute[75288]: DEBUG nova.objects.instance [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'info_cache' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:42 user nova-compute[75288]: DEBUG nova.objects.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.network.neutron [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Releasing lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:04:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance destroyed successfully.
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'resources' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_vif [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef8189f5-33, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1632f29d-d7d4-4d1d-a902-063073f4513f) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:43 user nova-compute[75288]: INFO os_vif [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33')
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARBrkwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:04:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[561fc3f0-9ae1-409f-a371-93f565a6d45e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:04:43 user nova-compute[75288]: No targets found.
Dec 01 14:04:43 user nova-compute[75288]: iSNS:
Dec 01 14:04:43 user nova-compute[75288]: No targets found.
Dec 01 14:04:43 user nova-compute[75288]: STATIC:
Dec 01 14:04:43 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b
Dec 01 14:04:43 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:04:43 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:04:43 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34
Dec 01 14:04:43 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:04:43 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:04:43 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:04:43 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:04:43 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:04:43 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d
Dec 01 14:04:43 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:04:43 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:04:43 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb
Dec 01 14:04:43 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:04:43 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:04:43 user nova-compute[75288]: FIRMWARE:
Dec 01 14:04:43 user nova-compute[75288]: No targets found.
Dec 01 14:04:43 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:04:43 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:04:43 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b502a76-d5f3-40b1-b9da-e6e12c3eb158]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b8ff18-072f-4c4a-ac87-3ca17ac8321c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:43 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:43 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:04:43 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:43 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:04:43 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:43 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:43 user nova-compute[75288]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:04:43 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:43 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:04:43 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbdc0f51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5580e15-aa88-4793-9965-1ab8a6f29929]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[40345f66-cffe-41eb-9924-900eab0c27ce]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[123ad994-070c-4534-a003-aa806aa15fdb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f1c10-a47b-480b-8d25-f95ce72e8091]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.050s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1aa57e-648d-4c2d-b443-4c9a7f5255f2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43780578-a769-4b68-a424-9434d7cf8174]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260]
Dec 01 14:04:43 user nova-compute[75288]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260] successful.
Dec 01 14:04:43 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[127fd5ba-1574-415e-9347-21db9f92a0f6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== disconnect_volume: return (350ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Start _get_guest_xml network_info=[{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '59e06cca-4b6d-4382-a054-9828f5a5c7e4', 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARBrkwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ba42382c-6649-4dd3-8ef6-aee0f151fda3', 'attached_at': '', 'detached_at': '', 'volume_id': '849575bf-c6fa-4ad5-9c53-14e4823b64bb', 'serial': '849575bf-c6fa-4ad5-9c53-14e4823b64bb'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'numa_topology' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:04:43 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.objects.instance [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.objects.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARBrkwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:04:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:04:43 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:04:43 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[074caedf-2ed1-464f-bebc-a45dc0abe533]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:04:43 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cee0a4-3eff-4dd5-99d9-de266cc1a9fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb] added
Dec 01 14:04:43 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc80176a-4284-49ce-bc59-48aa2ccfde2c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd434602-4c83-4181-ac89-5a422a76a187]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MARBrkwL {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MARBrkwL" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9bec8c-9670-4ca3-9202-3b7ce170f625]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MARBrkwL'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2a8b98-3dd6-4098-8d2a-ff9e927948ef]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:43 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c88bff-89e5-448c-8418-51456fffbb35]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:04:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:04:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[be84417c-ab6f-4d65-b33a-c97d41558eda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260]
Dec 01 14:04:44 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260] successful.
Dec 01 14:04:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62ffdad-97f5-41ce-8ef8-49b6e5c2f4b8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c4d07-34e5-42ba-bec4-56a5f5a3dc62]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:04:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:04:44 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:04:44 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1fdebd-13db-4f07-9ebc-92fe313ab4ca]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:04:44 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARBrkwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26662623337356534', 'path': '/dev/sde'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662623337356534', 'path': '/dev/sde'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'pci_devices' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.objects.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:04:45 user nova-compute[75288]:   <uuid>ba42382c-6649-4dd3-8ef6-aee0f151fda3</uuid>
Dec 01 14:04:45 user nova-compute[75288]:   <name>instance-00000026</name>
Dec 01 14:04:45 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:04:45 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:04:45 user nova-compute[75288]:   <metadata>
Dec 01 14:04:45 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:04:45 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:04:45 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeTestJSON-server-1282332462</nova:name>
Dec 01 14:04:45 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:04:43</nova:creationTime>
Dec 01 14:04:45 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:04:45 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:04:45 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:04:45 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:04:45 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:04:45 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:04:45 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:04:45 user nova-compute[75288]:       <nova:owner>
Dec 01 14:04:45 user nova-compute[75288]:         <nova:user uuid="9ce70853828047c2a95d82b34f79cc96">tempest-AttachVolumeTestJSON-800128847-project-member</nova:user>
Dec 01 14:04:45 user nova-compute[75288]:         <nova:project uuid="1d43be7c75dc4274801b9860ded7693d">tempest-AttachVolumeTestJSON-800128847</nova:project>
Dec 01 14:04:45 user nova-compute[75288]:       </nova:owner>
Dec 01 14:04:45 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:04:45 user nova-compute[75288]:       <nova:ports>
Dec 01 14:04:45 user nova-compute[75288]:         <nova:port uuid="ef8189f5-33cb-4afa-9d8b-2890e86c9e28">
Dec 01 14:04:45 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 14:04:45 user nova-compute[75288]:         </nova:port>
Dec 01 14:04:45 user nova-compute[75288]:       </nova:ports>
Dec 01 14:04:45 user nova-compute[75288]:     </nova:instance>
Dec 01 14:04:45 user nova-compute[75288]:   </metadata>
Dec 01 14:04:45 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:04:45 user nova-compute[75288]:     <system>
Dec 01 14:04:45 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:04:45 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:04:45 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:04:45 user nova-compute[75288]:       <entry name="serial">ba42382c-6649-4dd3-8ef6-aee0f151fda3</entry>
Dec 01 14:04:45 user nova-compute[75288]:       <entry name="uuid">ba42382c-6649-4dd3-8ef6-aee0f151fda3</entry>
Dec 01 14:04:45 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:04:45 user nova-compute[75288]:     </system>
Dec 01 14:04:45 user nova-compute[75288]:   </sysinfo>
Dec 01 14:04:45 user nova-compute[75288]:   <os>
Dec 01 14:04:45 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:04:45 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:04:45 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:04:45 user nova-compute[75288]:   </os>
Dec 01 14:04:45 user nova-compute[75288]:   <features>
Dec 01 14:04:45 user nova-compute[75288]:     <acpi/>
Dec 01 14:04:45 user nova-compute[75288]:     <apic/>
Dec 01 14:04:45 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:04:45 user nova-compute[75288]:   </features>
Dec 01 14:04:45 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:04:45 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:04:45 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:04:45 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:04:45 user nova-compute[75288]:   </clock>
Dec 01 14:04:45 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:04:45 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:04:45 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:04:45 user nova-compute[75288]:   </cpu>
Dec 01 14:04:45 user nova-compute[75288]:   <devices>
Dec 01 14:04:45 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:04:45 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:04:45 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk"/>
Dec 01 14:04:45 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:04:45 user nova-compute[75288]:     </disk>
Dec 01 14:04:45 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 14:04:45 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:04:45 user nova-compute[75288]:       <source dev="/dev/sde"/>
Dec 01 14:04:45 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 14:04:45 user nova-compute[75288]:       <serial>849575bf-c6fa-4ad5-9c53-14e4823b64bb</serial>
Dec 01 14:04:45 user nova-compute[75288]:     </disk>
Dec 01 14:04:45 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:04:45 user nova-compute[75288]:       <mac address="fa:16:3e:18:bf:e4"/>
Dec 01 14:04:45 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:04:45 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:04:45 user nova-compute[75288]:       <target dev="tapef8189f5-33"/>
Dec 01 14:04:45 user nova-compute[75288]:     </interface>
Dec 01 14:04:45 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:04:45 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/console.log" append="off"/>
Dec 01 14:04:45 user nova-compute[75288]:     </serial>
Dec 01 14:04:45 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:04:45 user nova-compute[75288]:     <video>
Dec 01 14:04:45 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:04:45 user nova-compute[75288]:     </video>
Dec 01 14:04:45 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:04:45 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:04:45 user nova-compute[75288]:     </rng>
Dec 01 14:04:45 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:04:45 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:04:45 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:04:45 user nova-compute[75288]:     </memballoon>
Dec 01 14:04:45 user nova-compute[75288]:   </devices>
Dec 01 14:04:45 user nova-compute[75288]: </domain>
Dec 01 14:04:45 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.objects.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.279s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:04:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Cannot resize image /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'migration_context' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.objects.base [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG os_vif [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fdf3614-d2b0-5080-bf87-e397cd38d26d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef8189f5-33, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef8189f5-33, col_values=(('qos', UUID('c4dad1dc-b05d-45a6-b291-240828c6f88f')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef8189f5-33, col_values=(('external_ids', {'iface-id': 'ef8189f5-33cb-4afa-9d8b-2890e86c9e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:bf:e4', 'vm-uuid': 'ba42382c-6649-4dd3-8ef6-aee0f151fda3'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:46 user nova-compute[75288]: INFO os_vif [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33')
Dec 01 14:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:46 user nova-compute[75288]: INFO nova.compute.manager [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Detaching volume 93d2e92c-dd18-4a5c-a881-98fec28a242b
Dec 01 14:04:46 user nova-compute[75288]: INFO nova.virt.block_device [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attempting to driver detach volume 93d2e92c-dd18-4a5c-a881-98fec28a242b from mountpoint /dev/vdb
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Attempting to detach device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:04:46 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:04:46 user nova-compute[75288]:   <source dev="/dev/sdf"/>
Dec 01 14:04:46 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:04:46 user nova-compute[75288]:   <serial>93d2e92c-dd18-4a5c-a881-98fec28a242b</serial>
Dec 01 14:04:46 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:04:46 user nova-compute[75288]: </disk>
Dec 01 14:04:46 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:04:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully detached device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the persistent domain config.
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:04:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:04:46 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:04:46 user nova-compute[75288]:   <source dev="/dev/sdf"/>
Dec 01 14:04:46 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:04:46 user nova-compute[75288]:   <serial>93d2e92c-dd18-4a5c-a881-98fec28a242b</serial>
Dec 01 14:04:46 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:04:46 user nova-compute[75288]: </disk>
Dec 01 14:04:46 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:47 user nova-compute[75288]: INFO nova.compute.manager [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Unshelving
Dec 01 14:04:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'pci_requests' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:04:47 user nova-compute[75288]: INFO nova.compute.claims [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Claim successful on node user
Dec 01 14:04:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Refreshing inventories for resource provider 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Updating ProviderTree inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Refreshing aggregate associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Refreshing trait associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-b614d538-7b34-4fb1-90b3-2a2909d39b25 req-6279ed4c-f7d8-4bd0-a711-cac9666bf2a9 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b614d538-7b34-4fb1-90b3-2a2909d39b25 req-6279ed4c-f7d8-4bd0-a711-cac9666bf2a9 service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b614d538-7b34-4fb1-90b3-2a2909d39b25 req-6279ed4c-f7d8-4bd0-a711-cac9666bf2a9 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b614d538-7b34-4fb1-90b3-2a2909d39b25 req-6279ed4c-f7d8-4bd0-a711-cac9666bf2a9 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-b614d538-7b34-4fb1-90b3-2a2909d39b25 req-6279ed4c-f7d8-4bd0-a711-cac9666bf2a9 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:04:48 user nova-compute[75288]: WARNING nova.compute.manager [req-b614d538-7b34-4fb1-90b3-2a2909d39b25 req-6279ed4c-f7d8-4bd0-a711-cac9666bf2a9 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state stopped and task_state powering-on.
Dec 01 14:04:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:48 user nova-compute[75288]: INFO nova.network.neutron [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating port 84c070b9-aa68-466b-adc9-dc6f190937a2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquired lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-c73fcd97-68a0-4d90-856a-66d0873a926e req-ed076177-51fe-4316-8a4d-13007e9a53e7 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-changed-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-c73fcd97-68a0-4d90-856a-66d0873a926e req-ed076177-51fe-4316-8a4d-13007e9a53e7 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Refreshing instance network info cache due to event network-changed-84c070b9-aa68-466b-adc9-dc6f190937a2. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c73fcd97-68a0-4d90-856a-66d0873a926e req-ed076177-51fe-4316-8a4d-13007e9a53e7 service nova] Acquiring lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating instance_info_cache with network_info: [{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Releasing lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:04:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Creating image(s)
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c73fcd97-68a0-4d90-856a-66d0873a926e req-ed076177-51fe-4316-8a4d-13007e9a53e7 service nova] Acquired lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-c73fcd97-68a0-4d90-856a-66d0873a926e req-ed076177-51fe-4316-8a4d-13007e9a53e7 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Refreshing network info cache for port 84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG nova.objects.base [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<9ae651bf-c461-46e1-bc89-182740d6fe04> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "64aa8831e9634510036a7c7461bd3c0e1abd3de3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "64aa8831e9634510036a7c7461bd3c0e1abd3de3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-087c6c15-ccb9-4c45-8d07-8fea42160231 req-6ccc4e85-7f72-4b5a-b84c-e86bb9806eae service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-087c6c15-ccb9-4c45-8d07-8fea42160231 req-6ccc4e85-7f72-4b5a-b84c-e86bb9806eae service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-087c6c15-ccb9-4c45-8d07-8fea42160231 req-6ccc4e85-7f72-4b5a-b84c-e86bb9806eae service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-087c6c15-ccb9-4c45-8d07-8fea42160231 req-6ccc4e85-7f72-4b5a-b84c-e86bb9806eae service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-087c6c15-ccb9-4c45-8d07-8fea42160231 req-6ccc4e85-7f72-4b5a-b84c-e86bb9806eae service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:04:50 user nova-compute[75288]: WARNING nova.compute.manager [req-087c6c15-ccb9-4c45-8d07-8fea42160231 req-6ccc4e85-7f72-4b5a-b84c-e86bb9806eae service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state stopped and task_state powering-on.
Dec 01 14:04:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:04:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance rebooted successfully.
Dec 01 14:04:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-079df888-3e9c-4668-854f-0385717ea986 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG nova.virt.images [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] 275ba717-217d-4fc2-b778-67e551544703 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 14:04:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3.part /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-c73fcd97-68a0-4d90-856a-66d0873a926e req-ed076177-51fe-4316-8a4d-13007e9a53e7 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updated VIF entry in instance network info cache for port 84c070b9-aa68-466b-adc9-dc6f190937a2. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-c73fcd97-68a0-4d90-856a-66d0873a926e req-ed076177-51fe-4316-8a4d-13007e9a53e7 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating instance_info_cache with network_info: [{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c73fcd97-68a0-4d90-856a-66d0873a926e req-ed076177-51fe-4316-8a4d-13007e9a53e7 service nova] Releasing lock "refresh_cache-9ae651bf-c461-46e1-bc89-182740d6fe04" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3.part /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3.converted" returned: 0 in 0.234s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "64aa8831e9634510036a7c7461bd3c0e1abd3de3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.524s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "64aa8831e9634510036a7c7461bd3c0e1abd3de3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "64aa8831e9634510036a7c7461bd3c0e1abd3de3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3 --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3,backing_fmt=raw /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3,backing_fmt=raw /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk 1073741824" returned: 0 in 0.052s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "64aa8831e9634510036a7c7461bd3c0e1abd3de3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3 --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:51 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'migration_context' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:52 user nova-compute[75288]: DEBUG nova.objects.base [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<9ae651bf-c461-46e1-bc89-182740d6fe04> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Rebasing disk image.
Dec 01 14:04:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.210s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a -F raw /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:04:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a -F raw /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk" returned: 0 in 1.937s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Ensure instance console log exists: /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Start _get_guest_xml network_info=[{"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d1fe9a4ff0e51e8f4342e99c03e4c8c4',container_format='bare',created_at=2023-12-01T14:02:54Z,direct_url=<?>,disk_format='qcow2',id=275ba717-217d-4fc2-b778-67e551544703,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2061549974-shelved',owner='d0ab4adede7a473d9b75844aa0d9da42',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-01T14:02:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:04:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:04:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d1fe9a4ff0e51e8f4342e99c03e4c8c4',container_format='bare',created_at=2023-12-01T14:02:54Z,direct_url=<?>,disk_format='qcow2',id=275ba717-217d-4fc2-b778-67e551544703,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2061549974-shelved',owner='d0ab4adede7a473d9b75844aa0d9da42',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-01T14:02:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.objects.base [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<9ae651bf-c461-46e1-bc89-182740d6fe04> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2061549974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2061549974',id=39,image_ref='275ba717-217d-4fc2-b778-67e551544703',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1949436941',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-5toak1n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member',shelved_at='2023-12-01T14:02:59.174328',shelved_host='user',shelved_image_id='275ba717-217d-4fc2-b778-67e551544703'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=9ae651bf-c461-46e1-bc89-182740d6fe04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.objects.base [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Object Instance<9ae651bf-c461-46e1-bc89-182740d6fe04> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:04:54 user nova-compute[75288]:   <uuid>9ae651bf-c461-46e1-bc89-182740d6fe04</uuid>
Dec 01 14:04:54 user nova-compute[75288]:   <name>instance-00000027</name>
Dec 01 14:04:54 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:04:54 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:04:54 user nova-compute[75288]:   <metadata>
Dec 01 14:04:54 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:04:54 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:04:54 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2061549974</nova:name>
Dec 01 14:04:54 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:04:54</nova:creationTime>
Dec 01 14:04:54 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:04:54 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:04:54 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:04:54 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:04:54 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:04:54 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:04:54 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:04:54 user nova-compute[75288]:       <nova:owner>
Dec 01 14:04:54 user nova-compute[75288]:         <nova:user uuid="4d51f494066a46c1b7fe1ed789318010">tempest-AttachVolumeShelveTestJSON-548010779-project-member</nova:user>
Dec 01 14:04:54 user nova-compute[75288]:         <nova:project uuid="d0ab4adede7a473d9b75844aa0d9da42">tempest-AttachVolumeShelveTestJSON-548010779</nova:project>
Dec 01 14:04:54 user nova-compute[75288]:       </nova:owner>
Dec 01 14:04:54 user nova-compute[75288]:       <nova:root type="image" uuid="275ba717-217d-4fc2-b778-67e551544703"/>
Dec 01 14:04:54 user nova-compute[75288]:       <nova:ports>
Dec 01 14:04:54 user nova-compute[75288]:         <nova:port uuid="84c070b9-aa68-466b-adc9-dc6f190937a2">
Dec 01 14:04:54 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 14:04:54 user nova-compute[75288]:         </nova:port>
Dec 01 14:04:54 user nova-compute[75288]:       </nova:ports>
Dec 01 14:04:54 user nova-compute[75288]:     </nova:instance>
Dec 01 14:04:54 user nova-compute[75288]:   </metadata>
Dec 01 14:04:54 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:04:54 user nova-compute[75288]:     <system>
Dec 01 14:04:54 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:04:54 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:04:54 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:04:54 user nova-compute[75288]:       <entry name="serial">9ae651bf-c461-46e1-bc89-182740d6fe04</entry>
Dec 01 14:04:54 user nova-compute[75288]:       <entry name="uuid">9ae651bf-c461-46e1-bc89-182740d6fe04</entry>
Dec 01 14:04:54 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:04:54 user nova-compute[75288]:     </system>
Dec 01 14:04:54 user nova-compute[75288]:   </sysinfo>
Dec 01 14:04:54 user nova-compute[75288]:   <os>
Dec 01 14:04:54 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:04:54 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:04:54 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:04:54 user nova-compute[75288]:   </os>
Dec 01 14:04:54 user nova-compute[75288]:   <features>
Dec 01 14:04:54 user nova-compute[75288]:     <acpi/>
Dec 01 14:04:54 user nova-compute[75288]:     <apic/>
Dec 01 14:04:54 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:04:54 user nova-compute[75288]:   </features>
Dec 01 14:04:54 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:04:54 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:04:54 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:04:54 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:04:54 user nova-compute[75288]:   </clock>
Dec 01 14:04:54 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:04:54 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:04:54 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:04:54 user nova-compute[75288]:   </cpu>
Dec 01 14:04:54 user nova-compute[75288]:   <devices>
Dec 01 14:04:54 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:04:54 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:04:54 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk"/>
Dec 01 14:04:54 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:04:54 user nova-compute[75288]:     </disk>
Dec 01 14:04:54 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:04:54 user nova-compute[75288]:       <mac address="fa:16:3e:c5:3b:b7"/>
Dec 01 14:04:54 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:04:54 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:04:54 user nova-compute[75288]:       <target dev="tap84c070b9-aa"/>
Dec 01 14:04:54 user nova-compute[75288]:     </interface>
Dec 01 14:04:54 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:04:54 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/console.log" append="off"/>
Dec 01 14:04:54 user nova-compute[75288]:     </serial>
Dec 01 14:04:54 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:04:54 user nova-compute[75288]:     <video>
Dec 01 14:04:54 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:04:54 user nova-compute[75288]:     </video>
Dec 01 14:04:54 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:04:54 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:04:54 user nova-compute[75288]:     </rng>
Dec 01 14:04:54 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:04:54 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:04:54 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:04:54 user nova-compute[75288]:     </memballoon>
Dec 01 14:04:54 user nova-compute[75288]:   </devices>
Dec 01 14:04:54 user nova-compute[75288]: </domain>
Dec 01 14:04:54 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2061549974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2061549974',id=39,image_ref='275ba717-217d-4fc2-b778-67e551544703',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1949436941',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-5toak1n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member',shelved_at='2023-12-01T14:02:59.174328',shelved_host='user',shelved_image_id='275ba717-217d-4fc2-b778-67e551544703'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:04:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=9ae651bf-c461-46e1-bc89-182740d6fe04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG os_vif [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16b06a50-fef6-535b-acb3-25c867f80e2c', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c070b9-aa, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c070b9-aa, col_values=(('qos', UUID('61181f2d-0ae6-4731-8bb8-bf593b0a3458')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c070b9-aa, col_values=(('external_ids', {'iface-id': '84c070b9-aa68-466b-adc9-dc6f190937a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:3b:b7', 'vm-uuid': '9ae651bf-c461-46e1-bc89-182740d6fe04'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:54 user nova-compute[75288]: INFO os_vif [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa')
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:04:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] No VIF found with MAC fa:16:3e:c5:3b:b7, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-b5a2f10a-a361-4eae-bdd0-aed07fb5a58b req-94a4b896-558d-4774-9f19-602043c15f97 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b5a2f10a-a361-4eae-bdd0-aed07fb5a58b req-94a4b896-558d-4774-9f19-602043c15f97 service nova] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b5a2f10a-a361-4eae-bdd0-aed07fb5a58b req-94a4b896-558d-4774-9f19-602043c15f97 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b5a2f10a-a361-4eae-bdd0-aed07fb5a58b req-94a4b896-558d-4774-9f19-602043c15f97 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-b5a2f10a-a361-4eae-bdd0-aed07fb5a58b req-94a4b896-558d-4774-9f19-602043c15f97 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] No waiting events found dispatching network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:04:55 user nova-compute[75288]: WARNING nova.compute.manager [req-b5a2f10a-a361-4eae-bdd0-aed07fb5a58b req-94a4b896-558d-4774-9f19-602043c15f97 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received unexpected event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 14:04:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:04:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:04:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:04:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance spawned successfully.
Dec 01 14:04:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-8089794a-7639-415f-9132-3719152f5e9f req-5b3fc068-1adc-4dfa-8cde-11a272f42d76 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:04:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8089794a-7639-415f-9132-3719152f5e9f req-5b3fc068-1adc-4dfa-8cde-11a272f42d76 service nova] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:04:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8089794a-7639-415f-9132-3719152f5e9f req-5b3fc068-1adc-4dfa-8cde-11a272f42d76 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:04:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8089794a-7639-415f-9132-3719152f5e9f req-5b3fc068-1adc-4dfa-8cde-11a272f42d76 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-8089794a-7639-415f-9132-3719152f5e9f req-5b3fc068-1adc-4dfa-8cde-11a272f42d76 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] No waiting events found dispatching network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:04:57 user nova-compute[75288]: WARNING nova.compute.manager [req-8089794a-7639-415f-9132-3719152f5e9f req-5b3fc068-1adc-4dfa-8cde-11a272f42d76 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received unexpected event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 14:04:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:04:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2d957e-7747-4da3-a833-f3924edf0c10 tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.426s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:04:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:07 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f is timed out.
Dec 01 14:05:07 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully detached device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the live domain config.
Dec 01 14:05:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RCJejxUA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:05:07 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0824407f-2b23-4d6f-ae44-3f1d546d8ff5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:05:07 user nova-compute[75288]: No targets found.
Dec 01 14:05:07 user nova-compute[75288]: iSNS:
Dec 01 14:05:07 user nova-compute[75288]: No targets found.
Dec 01 14:05:07 user nova-compute[75288]: STATIC:
Dec 01 14:05:07 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b
Dec 01 14:05:07 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:07 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:07 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34
Dec 01 14:05:07 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:07 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:07 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:05:07 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:07 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:07 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d
Dec 01 14:05:07 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:07 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:07 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb
Dec 01 14:05:07 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:07 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:07 user nova-compute[75288]: FIRMWARE:
Dec 01 14:05:07 user nova-compute[75288]: No targets found.
Dec 01 14:05:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:05:07 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:05:07 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[141307a3-af9a-45f9-a548-a866c0991829]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8fa61-d0c0-452d-9f79-621fbb83abcb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:07 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:07 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:05:07 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:05:07 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:07 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:07 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:05:07 user nova-compute[75288]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b (non-flash)
Dec 01 14:05:07 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc3eb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b'): ({'sdf'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Removing single pathed devices sdf {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1823f98-5210-44d9-bdec-0d8fbf176800]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c25136f-9c66-4d1d-a1a8-6e4cd7ccf0a4]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Flushing IO for device /dev/sdf {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b5e18a-6c8a-4b59-8942-414861664ae6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b66550-4e56-4d5c-be24-9f868b0dd4e8]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64aa3c3-65ea-41e7-9576-921ce4b402f2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e95bf7-838d-4665-a6cd-5a2a5c68d638]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b, portal: 172.16.0.220,3260]
Dec 01 14:05:07 user nova-compute[75288]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b, portal: 172.16.0.220,3260] successful.
Dec 01 14:05:07 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d2e92c-dd18-4a5c-a881-98fec28a242b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb0103a-fd6f-47c8-a9f0-74d19dc58aaf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== disconnect_volume: return (338ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:05:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:08 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:05:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2795a006-cd1b-49d0-b63f-b8bc2067ed8f tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:05:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:05:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:05:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:05:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Updating instance_info_cache with network_info: [{"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:05:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-8a0ae420-3d13-48e9-88fa-432b97c27a28" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:05:18 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:05:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-f43057ff-51a5-4ae7-858e-c9e6f0619b8a req-cce9fc89-c92f-46da-9b31-9a20fd2c1b96 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-changed-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-f43057ff-51a5-4ae7-858e-c9e6f0619b8a req-cce9fc89-c92f-46da-9b31-9a20fd2c1b96 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Refreshing instance network info cache due to event network-changed-13c76a3f-58ea-4c3e-a668-d0951601b610. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f43057ff-51a5-4ae7-858e-c9e6f0619b8a req-cce9fc89-c92f-46da-9b31-9a20fd2c1b96 service nova] Acquiring lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f43057ff-51a5-4ae7-858e-c9e6f0619b8a req-cce9fc89-c92f-46da-9b31-9a20fd2c1b96 service nova] Acquired lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG nova.network.neutron [req-f43057ff-51a5-4ae7-858e-c9e6f0619b8a req-cce9fc89-c92f-46da-9b31-9a20fd2c1b96 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Refreshing network info cache for port 13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:05:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-f43057ff-51a5-4ae7-858e-c9e6f0619b8a req-cce9fc89-c92f-46da-9b31-9a20fd2c1b96 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updated VIF entry in instance network info cache for port 13c76a3f-58ea-4c3e-a668-d0951601b610. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG nova.network.neutron [req-f43057ff-51a5-4ae7-858e-c9e6f0619b8a req-cce9fc89-c92f-46da-9b31-9a20fd2c1b96 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updating instance_info_cache with network_info: [{"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f43057ff-51a5-4ae7-858e-c9e6f0619b8a req-cce9fc89-c92f-46da-9b31-9a20fd2c1b96 service nova] Releasing lock "refresh_cache-4be22849-cc7f-4d2c-a164-64b5f9e209f8" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:21 user nova-compute[75288]: INFO nova.compute.manager [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Rebuilding instance
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-a7af5faa-016e-477c-8641-82a03b538bc2 req-4916e5db-ce78-4a52-a996-c0ec19a5ccfe service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-unplugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a7af5faa-016e-477c-8641-82a03b538bc2 req-4916e5db-ce78-4a52-a996-c0ec19a5ccfe service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a7af5faa-016e-477c-8641-82a03b538bc2 req-4916e5db-ce78-4a52-a996-c0ec19a5ccfe service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a7af5faa-016e-477c-8641-82a03b538bc2 req-4916e5db-ce78-4a52-a996-c0ec19a5ccfe service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-a7af5faa-016e-477c-8641-82a03b538bc2 req-4916e5db-ce78-4a52-a996-c0ec19a5ccfe service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] No waiting events found dispatching network-vif-unplugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:05:22 user nova-compute[75288]: WARNING nova.compute.manager [req-a7af5faa-016e-477c-8641-82a03b538bc2 req-4916e5db-ce78-4a52-a996-c0ec19a5ccfe service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received unexpected event network-vif-unplugged-13c76a3f-58ea-4c3e-a668-d0951601b610 for instance with vm_state active and task_state rebuilding.
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance destroyed successfully.
Dec 01 14:05:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:05:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:05:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8089MB free_disk=24.85623550415039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance destroyed successfully.
Dec 01 14:05:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-610581160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1482792749',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc7FfvG1tx1bhwWaV0yEVXohOMyaxsQiapAzm0VI2IldJ/xYPeLxsqGNLjT+nDVD7q/i7w42TB7DdWiOaxUi1lxBE/jXsx6YaiFWJlQOTRIY16v61SJk+LkCAuS6vCezQ==',key_name='tempest-keypair-1123464944',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:03:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='538347059fc54fb9a5da690fa138daae',ramdisk_id='',reservation_id='r-s1m2c1jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-491583892',owner_user_name='tempest-ServerActionsV293TestJSON-491583892-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3fc71e453145b3bba513c6bed1db09',uuid=4be22849-cc7f-4d2c-a164-64b5f9e209f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converting VIF {"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG os_vif [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13c76a3f-58, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d63e1c4-4369-4e01-98ae-9c1b59332a03) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:23 user nova-compute[75288]: INFO os_vif [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58')
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:05:23 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c5f2f8-2106-4709-bf4c-2fcc0af3ad0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:05:23 user nova-compute[75288]: No targets found.
Dec 01 14:05:23 user nova-compute[75288]: iSNS:
Dec 01 14:05:23 user nova-compute[75288]: No targets found.
Dec 01 14:05:23 user nova-compute[75288]: STATIC:
Dec 01 14:05:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34
Dec 01 14:05:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:05:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d
Dec 01 14:05:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb
Dec 01 14:05:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:23 user nova-compute[75288]: FIRMWARE:
Dec 01 14:05:23 user nova-compute[75288]: No targets found.
Dec 01 14:05:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:05:23 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:05:23 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153107a-59b4-48b4-a086-7419370c6381]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 28c7d2bd-7c14-4dbd-a798-48eb6546c51c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 4be22849-cc7f-4d2c-a164-64b5f9e209f8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 9ae651bf-c461-46e1-bc89-182740d6fe04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[38315566-3992-4e62-b2e7-7d7bec7a3a38]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98b123b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5af285-bca0-4de6-a07f-6188653346f9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e52d2d-c4fa-4bb5-a57e-ade0f43fc292]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77b716e-a47f-4dc3-9a86-6a9b51f65f78]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21ecbe-687f-4e61-a1ec-95b52a72395c]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[84711a50-8c7e-44a2-b246-9a1a48001b77]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34738e2f-c7f4-4e40-a552-37b7ebca78d3]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260]
Dec 01 14:05:23 user nova-compute[75288]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260] successful.
Dec 01 14:05:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fa3b0e-1bd6-4ffa-b121-b1dbb1a95d36]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] <== disconnect_volume: return (349ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:05:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Deleting instance files /opt/stack/data/nova/instances/4be22849-cc7f-4d2c-a164-64b5f9e209f8_del
Dec 01 14:05:23 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Deletion of /opt/stack/data/nova/instances/4be22849-cc7f-4d2c-a164-64b5f9e209f8_del complete
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 4be22849-cc7f-4d2c-a164-64b5f9e209f8 could not be found.
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:05:23 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f559d44-45cf-4b69-b558-630efd1cf833]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:05:23 user nova-compute[75288]: No targets found.
Dec 01 14:05:23 user nova-compute[75288]: iSNS:
Dec 01 14:05:23 user nova-compute[75288]: No targets found.
Dec 01 14:05:23 user nova-compute[75288]: STATIC:
Dec 01 14:05:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34
Dec 01 14:05:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:05:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:23 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb
Dec 01 14:05:23 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:23 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:23 user nova-compute[75288]: FIRMWARE:
Dec 01 14:05:23 user nova-compute[75288]: No targets found.
Dec 01 14:05:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:05:23 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:05:23 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae60c7b-1bd7-42fc-b84f-88eb42ef491a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[de593776-5614-428f-8d42-7aff7d53cfef]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:23 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:23 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e3a560>, {}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Disconnecting from: [] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] <== disconnect_volume: return (75ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:05:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:05:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-30c13ccc-6d63-4069-a219-d186f6e26128 req-f9aa3e3e-d0cc-4f89-b83f-e651315551f4 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30c13ccc-6d63-4069-a219-d186f6e26128 req-f9aa3e3e-d0cc-4f89-b83f-e651315551f4 service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30c13ccc-6d63-4069-a219-d186f6e26128 req-f9aa3e3e-d0cc-4f89-b83f-e651315551f4 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-30c13ccc-6d63-4069-a219-d186f6e26128 req-f9aa3e3e-d0cc-4f89-b83f-e651315551f4 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:24 user nova-compute[75288]: DEBUG nova.compute.manager [req-30c13ccc-6d63-4069-a219-d186f6e26128 req-f9aa3e3e-d0cc-4f89-b83f-e651315551f4 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] No waiting events found dispatching network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:05:24 user nova-compute[75288]: WARNING nova.compute.manager [req-30c13ccc-6d63-4069-a219-d186f6e26128 req-f9aa3e3e-d0cc-4f89-b83f-e651315551f4 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received unexpected event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 for instance with vm_state active and task_state rebuilding.
Dec 01 14:05:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Preparing to wait for external event volume-reimaged-469e7cb7-71e7-499d-b092-6c9182578f0d {{(pid=75288) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 01 14:05:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:05:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:05:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:05:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:05:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:05:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:05:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:39 user nova-compute[75288]: INFO nova.compute.manager [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attaching volume 5d510cdc-e48d-41c9-aaa5-390926cbad46 to /dev/vdb
Dec 01 14:05:39 user nova-compute[75288]: DEBUG os_brick.utils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c7cd12-5006-4993-9af8-3ee8356d5a19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e255186-8a96-4010-a591-d264b30d2e70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28849eff-8778-4532-a43c-b2e70db6578f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35a2883-9bf4-4b04-a396-9675ba4b0108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:05:40 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:05:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94232cd-c91b-499a-b0c9-340beb01e797]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG os_brick.utils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:05:40 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating existing volume attachment record: 23533431-6d76-44a2-9a40-d414f69d3643 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-82e2e1d7-0919-477b-a044-cf6c81cf867a req-f6a2a244-5972-43b0-982d-3ceb6d1acccf service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event volume-reimaged-469e7cb7-71e7-499d-b092-6c9182578f0d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-82e2e1d7-0919-477b-a044-cf6c81cf867a req-f6a2a244-5972-43b0-982d-3ceb6d1acccf service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-82e2e1d7-0919-477b-a044-cf6c81cf867a req-f6a2a244-5972-43b0-982d-3ceb6d1acccf service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-82e2e1d7-0919-477b-a044-cf6c81cf867a req-f6a2a244-5972-43b0-982d-3ceb6d1acccf service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-82e2e1d7-0919-477b-a044-cf6c81cf867a req-f6a2a244-5972-43b0-982d-3ceb6d1acccf service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Processing event volume-reimaged-469e7cb7-71e7-499d-b092-6c9182578f0d {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG nova.compute.manager [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:05:41 user nova-compute[75288]: INFO nova.virt.block_device [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Booting with volume 469e7cb7-71e7-499d-b092-6c9182578f0d at /dev/vda
Dec 01 14:05:41 user nova-compute[75288]: DEBUG os_brick.utils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4647774-bc81-4476-bf25-06a0e03757e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac49e6c-c39b-4ce4-9047-1b6852d63979]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f472177-497c-4365-9959-d12c73fd2438]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f084cd6-599d-42e5-9a23-062810b08150]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:05:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:42 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:05:42 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:05:42 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[224f850e-a6b4-4174-be39-17f23b7080cc]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:05:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:05:42 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:05:42 user nova-compute[75288]: DEBUG os_brick.utils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:05:42 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updating existing volume attachment record: d247a153-2379-4427-9fac-a61ac0a03c5c {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:05:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTyepgsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:05:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:05:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:05:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:05:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:05:49 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f191aa62-19e4-44a3-8d4a-4d3467890b03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:05:49 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e1ae8c-a357-4667-9e7e-df3365a68c11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46] added
Dec 01 14:05:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd7df1-3c4f-4507-a66e-41acf956458a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[58402c2d-d369-4973-b3aa-a61f64b527f8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTyepgsn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTyepgsn" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fbb1a-f9a8-45ab-93a4-7c14fd3644d3]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wTyepgsn'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f975a-ac27-4bfa-84a7-cd41b5b7db60]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[938f6428-0f24-40da-8563-de87d630a35e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:50 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:50 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb436c2-c532-4ade-b90e-f9ba11bcbd6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46, portal: 172.16.0.220,3260]
Dec 01 14:05:50 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46, portal: 172.16.0.220,3260] successful.
Dec 01 14:05:50 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04271cf5-fa52-4719-a10f-568058aadd2f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b78a8dc-9ccf-4d45-b09e-54bd6760c327]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:05:50 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:50 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:05:50 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54e976e-e2e5-4a88-8b5d-d8887d130c41]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:05:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTyepgsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23161373864336136', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161373864336136', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:05:51 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:05:51 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:05:51 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:05:51 user nova-compute[75288]:   <serial>5d510cdc-e48d-41c9-aaa5-390926cbad46</serial>
Dec 01 14:05:51 user nova-compute[75288]: </disk>
Dec 01 14:05:51 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:05:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Creating image(s)
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Ensure instance console log exists: /opt/stack/data/nova/instances/4be22849-cc7f-4d2c-a164-64b5f9e209f8/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Start _get_guest_xml network_info=[{"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd247a153-2379-4427-9fac-a61ac0a03c5c', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4be22849-cc7f-4d2c-a164-64b5f9e209f8', 'attached_at': '', 'detached_at': '', 'volume_id': '469e7cb7-71e7-499d-b092-6c9182578f0d', 'serial': '469e7cb7-71e7-499d-b092-6c9182578f0d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No VIF found with MAC fa:16:3e:7c:b8:ac, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:05:51 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 14:05:51 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.objects.instance [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4be22849-cc7f-4d2c-a164-64b5f9e209f8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:05:51 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:05:51 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:05:51 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f59a25-dea8-4c11-bb95-7189ac648084]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:05:51 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d4414a-7970-42a9-827a-dec84e94566c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d] added
Dec 01 14:05:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e7b1dd0a-8157-4abc-96f4-930210ebf110 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.899s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bf689b-4c10-4992-b810-e6435f1b54d8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6a7ecd-e948-48da-a7e9-1311257237a2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhSHQaWp {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhSHQaWp" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c69df-c1f0-4d49-bac6-6a85a1d79c61]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vhSHQaWp'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc18a8d-9a9f-448a-9004-9a8f7da591f7]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28713051-1f5b-4472-9de2-833121d884d2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:51 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:51 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:51 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:05:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:51 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:51 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:51 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:05:51 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:05:51 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391eaf8-17d9-418d-a643-7822c21d2f58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260]
Dec 01 14:05:52 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260] successful.
Dec 01 14:05:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b396532b-c2ff-4cd6-889b-6d6876a6b1ce]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c60f41-8a44-411b-b9ef-a73f8744a575]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:52 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:52 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:52 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:05:52 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:05:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:52 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:52 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:52 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:05:52 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:05:52 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa2075d-2155-4bc2-850f-88976d3bad62]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:05:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26635393438393965', 'path': '/dev/sdf'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635393438393965', 'path': '/dev/sdf'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-610581160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1482792749',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc7FfvG1tx1bhwWaV0yEVXohOMyaxsQiapAzm0VI2IldJ/xYPeLxsqGNLjT+nDVD7q/i7w42TB7DdWiOaxUi1lxBE/jXsx6YaiFWJlQOTRIY16v61SJk+LkCAuS6vCezQ==',key_name='tempest-keypair-1123464944',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:03:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='538347059fc54fb9a5da690fa138daae',ramdisk_id='',reservation_id='r-s1m2c1jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-491583892',owner_user_name='tempest-ServerActionsV293TestJSON-491583892-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3fc71e453145b3bba513c6bed1db09',uuid=4be22849-cc7f-4d2c-a164-64b5f9e209f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converting VIF {"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:05:53 user nova-compute[75288]:   <uuid>4be22849-cc7f-4d2c-a164-64b5f9e209f8</uuid>
Dec 01 14:05:53 user nova-compute[75288]:   <name>instance-00000029</name>
Dec 01 14:05:53 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:05:53 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:05:53 user nova-compute[75288]:   <metadata>
Dec 01 14:05:53 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:05:53 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:05:53 user nova-compute[75288]:       <nova:name>tempest-ServerActionsV293TestJSON-server-610581160</nova:name>
Dec 01 14:05:53 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:05:51</nova:creationTime>
Dec 01 14:05:53 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:05:53 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:05:53 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:05:53 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:05:53 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:05:53 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:05:53 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:05:53 user nova-compute[75288]:       <nova:owner>
Dec 01 14:05:53 user nova-compute[75288]:         <nova:user uuid="4c3fc71e453145b3bba513c6bed1db09">tempest-ServerActionsV293TestJSON-491583892-project-member</nova:user>
Dec 01 14:05:53 user nova-compute[75288]:         <nova:project uuid="538347059fc54fb9a5da690fa138daae">tempest-ServerActionsV293TestJSON-491583892</nova:project>
Dec 01 14:05:53 user nova-compute[75288]:       </nova:owner>
Dec 01 14:05:53 user nova-compute[75288]:       <nova:ports>
Dec 01 14:05:53 user nova-compute[75288]:         <nova:port uuid="13c76a3f-58ea-4c3e-a668-d0951601b610">
Dec 01 14:05:53 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 14:05:53 user nova-compute[75288]:         </nova:port>
Dec 01 14:05:53 user nova-compute[75288]:       </nova:ports>
Dec 01 14:05:53 user nova-compute[75288]:     </nova:instance>
Dec 01 14:05:53 user nova-compute[75288]:   </metadata>
Dec 01 14:05:53 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:05:53 user nova-compute[75288]:     <system>
Dec 01 14:05:53 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:05:53 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:05:53 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:05:53 user nova-compute[75288]:       <entry name="serial">4be22849-cc7f-4d2c-a164-64b5f9e209f8</entry>
Dec 01 14:05:53 user nova-compute[75288]:       <entry name="uuid">4be22849-cc7f-4d2c-a164-64b5f9e209f8</entry>
Dec 01 14:05:53 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:05:53 user nova-compute[75288]:     </system>
Dec 01 14:05:53 user nova-compute[75288]:   </sysinfo>
Dec 01 14:05:53 user nova-compute[75288]:   <os>
Dec 01 14:05:53 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:05:53 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:05:53 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:05:53 user nova-compute[75288]:   </os>
Dec 01 14:05:53 user nova-compute[75288]:   <features>
Dec 01 14:05:53 user nova-compute[75288]:     <acpi/>
Dec 01 14:05:53 user nova-compute[75288]:     <apic/>
Dec 01 14:05:53 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:05:53 user nova-compute[75288]:   </features>
Dec 01 14:05:53 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:05:53 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:05:53 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:05:53 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:05:53 user nova-compute[75288]:   </clock>
Dec 01 14:05:53 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:05:53 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:05:53 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:05:53 user nova-compute[75288]:   </cpu>
Dec 01 14:05:53 user nova-compute[75288]:   <devices>
Dec 01 14:05:53 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 14:05:53 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:05:53 user nova-compute[75288]:       <source dev="/dev/sdf"/>
Dec 01 14:05:53 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:05:53 user nova-compute[75288]:       <serial>469e7cb7-71e7-499d-b092-6c9182578f0d</serial>
Dec 01 14:05:53 user nova-compute[75288]:     </disk>
Dec 01 14:05:53 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:05:53 user nova-compute[75288]:       <mac address="fa:16:3e:48:ba:8c"/>
Dec 01 14:05:53 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:05:53 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:05:53 user nova-compute[75288]:       <target dev="tap13c76a3f-58"/>
Dec 01 14:05:53 user nova-compute[75288]:     </interface>
Dec 01 14:05:53 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:05:53 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/4be22849-cc7f-4d2c-a164-64b5f9e209f8/console.log" append="off"/>
Dec 01 14:05:53 user nova-compute[75288]:     </serial>
Dec 01 14:05:53 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:05:53 user nova-compute[75288]:     <video>
Dec 01 14:05:53 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:05:53 user nova-compute[75288]:     </video>
Dec 01 14:05:53 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:05:53 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:05:53 user nova-compute[75288]:     </rng>
Dec 01 14:05:53 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:05:53 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:05:53 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:05:53 user nova-compute[75288]:     </memballoon>
Dec 01 14:05:53 user nova-compute[75288]:   </devices>
Dec 01 14:05:53 user nova-compute[75288]: </domain>
Dec 01 14:05:53 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-610581160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1482792749',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc7FfvG1tx1bhwWaV0yEVXohOMyaxsQiapAzm0VI2IldJ/xYPeLxsqGNLjT+nDVD7q/i7w42TB7DdWiOaxUi1lxBE/jXsx6YaiFWJlQOTRIY16v61SJk+LkCAuS6vCezQ==',key_name='tempest-keypair-1123464944',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:03:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='538347059fc54fb9a5da690fa138daae',ramdisk_id='',reservation_id='r-s1m2c1jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-491583892',owner_user_name='tempest-ServerActionsV293TestJSON-491583892-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3fc71e453145b3bba513c6bed1db09',uuid=4be22849-cc7f-4d2c-a164-64b5f9e209f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converting VIF {"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG os_vif [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9275c7b8-d6b6-52f7-8a34-365ca0306703', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13c76a3f-58, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13c76a3f-58, col_values=(('qos', UUID('b4ddc7dc-f3b4-49da-bae2-5d16adfeeb5e')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13c76a3f-58, col_values=(('external_ids', {'iface-id': '13c76a3f-58ea-4c3e-a668-d0951601b610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:ba:8c', 'vm-uuid': '4be22849-cc7f-4d2c-a164-64b5f9e209f8'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:53 user nova-compute[75288]: INFO os_vif [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58')
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:05:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] No VIF found with MAC fa:16:3e:48:ba:8c, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:54 user nova-compute[75288]: INFO nova.compute.manager [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Detaching volume 5d510cdc-e48d-41c9-aaa5-390926cbad46
Dec 01 14:05:54 user nova-compute[75288]: INFO nova.virt.block_device [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attempting to driver detach volume 5d510cdc-e48d-41c9-aaa5-390926cbad46 from mountpoint /dev/vdb
Dec 01 14:05:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Attempting to detach device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:05:54 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:05:54 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:05:54 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:05:54 user nova-compute[75288]:   <serial>5d510cdc-e48d-41c9-aaa5-390926cbad46</serial>
Dec 01 14:05:54 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:05:54 user nova-compute[75288]: </disk>
Dec 01 14:05:54 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:05:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully detached device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the persistent domain config.
Dec 01 14:05:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:05:54 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:05:54 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:05:54 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:05:54 user nova-compute[75288]:   <serial>5d510cdc-e48d-41c9-aaa5-390926cbad46</serial>
Dec 01 14:05:54 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:05:54 user nova-compute[75288]: </disk>
Dec 01 14:05:54 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-d26e6af4-9bb2-48f5-8f43-5855a3e9f2c4 req-7ed30d77-5aae-4bb3-8d68-2b13e95c4f41 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d26e6af4-9bb2-48f5-8f43-5855a3e9f2c4 req-7ed30d77-5aae-4bb3-8d68-2b13e95c4f41 service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d26e6af4-9bb2-48f5-8f43-5855a3e9f2c4 req-7ed30d77-5aae-4bb3-8d68-2b13e95c4f41 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d26e6af4-9bb2-48f5-8f43-5855a3e9f2c4 req-7ed30d77-5aae-4bb3-8d68-2b13e95c4f41 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-d26e6af4-9bb2-48f5-8f43-5855a3e9f2c4 req-7ed30d77-5aae-4bb3-8d68-2b13e95c4f41 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] No waiting events found dispatching network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:05:54 user nova-compute[75288]: WARNING nova.compute.manager [req-d26e6af4-9bb2-48f5-8f43-5855a3e9f2c4 req-7ed30d77-5aae-4bb3-8d68-2b13e95c4f41 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received unexpected event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 14:05:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:05:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:56 user nova-compute[75288]: INFO nova.compute.manager [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Terminating instance
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-d5e64833-249a-41e8-b868-57bcdd9f660b req-65cdb67a-207b-4185-929e-8a3587fa4393 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d5e64833-249a-41e8-b868-57bcdd9f660b req-65cdb67a-207b-4185-929e-8a3587fa4393 service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d5e64833-249a-41e8-b868-57bcdd9f660b req-65cdb67a-207b-4185-929e-8a3587fa4393 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d5e64833-249a-41e8-b868-57bcdd9f660b req-65cdb67a-207b-4185-929e-8a3587fa4393 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-d5e64833-249a-41e8-b868-57bcdd9f660b req-65cdb67a-207b-4185-929e-8a3587fa4393 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] No waiting events found dispatching network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:05:56 user nova-compute[75288]: WARNING nova.compute.manager [req-d5e64833-249a-41e8-b868-57bcdd9f660b req-65cdb67a-207b-4185-929e-8a3587fa4393 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received unexpected event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-41c55555-d7d1-413d-9d91-1d8bea91951d req-2365f45a-f590-45c4-b0b0-040f64dcca2a service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41c55555-d7d1-413d-9d91-1d8bea91951d req-2365f45a-f590-45c4-b0b0-040f64dcca2a service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41c55555-d7d1-413d-9d91-1d8bea91951d req-2365f45a-f590-45c4-b0b0-040f64dcca2a service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41c55555-d7d1-413d-9d91-1d8bea91951d req-2365f45a-f590-45c4-b0b0-040f64dcca2a service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-41c55555-d7d1-413d-9d91-1d8bea91951d req-2365f45a-f590-45c4-b0b0-040f64dcca2a service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-41c55555-d7d1-413d-9d91-1d8bea91951d req-2365f45a-f590-45c4-b0b0-040f64dcca2a service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-unplugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:56 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance spawned successfully.
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:05:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75288) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-82e2e1d7-0919-477b-a044-cf6c81cf867a tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Instance destroyed successfully.
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'resources' on Instance uuid 28c7d2bd-7c14-4dbd-a798-48eb6546c51c {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-249953189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-249953189',id=37,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:02:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-jcvt2cdg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:04:10Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=28c7d2bd-7c14-4dbd-a798-48eb6546c51c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "53631e8a-d098-4366-9070-7a6c5e255f48", "address": "fa:16:3e:7a:5e:04", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53631e8a-d0", "ovs_interfaceid": "53631e8a-d098-4366-9070-7a6c5e255f48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:5e:04,bridge_name='br-int',has_traffic_filtering=True,id=53631e8a-d098-4366-9070-7a6c5e255f48,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53631e8a-d0') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_vif [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:5e:04,bridge_name='br-int',has_traffic_filtering=True,id=53631e8a-d098-4366-9070-7a6c5e255f48,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53631e8a-d0') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53631e8a-d0, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=400a4137-456d-4a19-ae71-f15d53c9cc34) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:05:57 user nova-compute[75288]: INFO os_vif [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:5e:04,bridge_name='br-int',has_traffic_filtering=True,id=53631e8a-d098-4366-9070-7a6c5e255f48,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53631e8a-d0')
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'buMekcFr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:05:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e74bc38-245b-4a06-adca-d536b0c4f695]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:05:57 user nova-compute[75288]: No targets found.
Dec 01 14:05:57 user nova-compute[75288]: iSNS:
Dec 01 14:05:57 user nova-compute[75288]: No targets found.
Dec 01 14:05:57 user nova-compute[75288]: STATIC:
Dec 01 14:05:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34
Dec 01 14:05:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:57 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:05:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:57 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d
Dec 01 14:05:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:57 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46
Dec 01 14:05:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:57 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb
Dec 01 14:05:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:05:57 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:05:57 user nova-compute[75288]: FIRMWARE:
Dec 01 14:05:57 user nova-compute[75288]: No targets found.
Dec 01 14:05:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:05:57 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:05:57 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2237a4b-63dc-4ca2-a18d-42dd762f64ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9802d9c4-aed3-49d2-87d4-49e6279fc2c0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:57 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:57 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:57 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:05:57 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:05:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:05:57 user nova-compute[75288]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 (non-flash)
Dec 01 14:05:57 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:05:57 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:05:57 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:05:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc3eb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34'): ({'sdd'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Removing single pathed devices sdd {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[694ed934-0e37-40c5-a569-0f8dabfa4b16]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cbdddd-1799-467c-8cc6-1b0163cb50bf]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flushing IO for device /dev/sdd {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7699191a-1a32-4c22-9c31-8e0a527b5fbc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94988c8-2f99-440e-8972-20b79c922a84]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] SCSI volumes sdd have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd02dc8-91c9-4df4-970a-db80aab2db77]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c6619e-a416-4144-9df1-aa5ebb6ed640]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34, portal: 172.16.0.220,3260]
Dec 01 14:05:57 user nova-compute[75288]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34, portal: 172.16.0.220,3260] successful.
Dec 01 14:05:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:501208d1-fba1-41f1-87e1-d71db7cfed34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aa16b9-cd66-438a-ba2b-6cd4cdc3ab20]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] <== disconnect_volume: return (368ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:05:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Deleting instance files /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c_del
Dec 01 14:05:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Deletion of /opt/stack/data/nova/instances/28c7d2bd-7c14-4dbd-a798-48eb6546c51c_del complete
Dec 01 14:05:57 user nova-compute[75288]: INFO nova.compute.manager [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Took 1.23 seconds to destroy the instance on the hypervisor.
Dec 01 14:05:57 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:05:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:05:58 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:05:58 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Took 0.50 seconds to deallocate network for instance.
Dec 01 14:05:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-ebbcf1a0-9f06-4d6c-bc00-12a34afa5bf8 req-9bb0d454-251b-438f-ab28-e20eea584a33 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-deleted-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:58 user nova-compute[75288]: INFO nova.compute.manager [req-ebbcf1a0-9f06-4d6c-bc00-12a34afa5bf8 req-9bb0d454-251b-438f-ab28-e20eea584a33 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Neutron deleted interface 53631e8a-d098-4366-9070-7a6c5e255f48; detaching it from the instance and deleting it from the info cache
Dec 01 14:05:58 user nova-compute[75288]: DEBUG nova.network.neutron [req-ebbcf1a0-9f06-4d6c-bc00-12a34afa5bf8 req-9bb0d454-251b-438f-ab28-e20eea584a33 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:05:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-ebbcf1a0-9f06-4d6c-bc00-12a34afa5bf8 req-9bb0d454-251b-438f-ab28-e20eea584a33 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Detach interface failed, port_id=53631e8a-d098-4366-9070-7a6c5e255f48, reason: Instance 28c7d2bd-7c14-4dbd-a798-48eb6546c51c could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:05:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-165550da-773e-46b5-9603-6ff64bcd8c21 req-41bc7ee4-4d8b-4c98-8829-c58516db64c7 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165550da-773e-46b5-9603-6ff64bcd8c21 req-41bc7ee4-4d8b-4c98-8829-c58516db64c7 service nova] Acquiring lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165550da-773e-46b5-9603-6ff64bcd8c21 req-41bc7ee4-4d8b-4c98-8829-c58516db64c7 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-165550da-773e-46b5-9603-6ff64bcd8c21 req-41bc7ee4-4d8b-4c98-8829-c58516db64c7 service nova] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-165550da-773e-46b5-9603-6ff64bcd8c21 req-41bc7ee4-4d8b-4c98-8829-c58516db64c7 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] No waiting events found dispatching network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:05:58 user nova-compute[75288]: WARNING nova.compute.manager [req-165550da-773e-46b5-9603-6ff64bcd8c21 req-41bc7ee4-4d8b-4c98-8829-c58516db64c7 service nova] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Received unexpected event network-vif-plugged-53631e8a-d098-4366-9070-7a6c5e255f48 for instance with vm_state active and task_state deleting.
Dec 01 14:05:59 user nova-compute[75288]: INFO nova.compute.manager [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 28c7d2bd-7c14-4dbd-a798-48eb6546c51c] Took 0.83 seconds to detach 1 volumes for instance.
Dec 01 14:05:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:05:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:05:59 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:05:59 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:05:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:05:59 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Deleted allocations for instance 28c7d2bd-7c14-4dbd-a798-48eb6546c51c
Dec 01 14:05:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f3011b1f-daba-4270-8341-83d76faac701 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "28c7d2bd-7c14-4dbd-a798-48eb6546c51c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:06:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:06:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:06:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:06:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:06:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:06:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f is timed out.
Dec 01 14:06:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully detached device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the live domain config.
Dec 01 14:06:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTyepgsn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:06:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c972425-9370-428f-8942-9a1a3e922cf4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:06:15 user nova-compute[75288]: No targets found.
Dec 01 14:06:15 user nova-compute[75288]: iSNS:
Dec 01 14:06:15 user nova-compute[75288]: No targets found.
Dec 01 14:06:15 user nova-compute[75288]: STATIC:
Dec 01 14:06:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:06:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:06:15 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:06:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d
Dec 01 14:06:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:06:15 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:06:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46
Dec 01 14:06:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:06:15 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:06:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb
Dec 01 14:06:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:06:15 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:06:15 user nova-compute[75288]: FIRMWARE:
Dec 01 14:06:15 user nova-compute[75288]: No targets found.
Dec 01 14:06:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:06:15 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:06:15 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7504f9e6-d52b-473b-92b6-82a13693410c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf6b081-5e73-45fc-bb03-3242f797cbe5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:06:15 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:06:15 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:06:15 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:06:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:06:15 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:06:15 user nova-compute[75288]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 (non-flash)
Dec 01 14:06:15 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:06:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e895a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b927d62-d886-4e93-9d2b-296bbf529c35]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0510100-a607-42d5-b71f-a7ce878ca40a]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d76dd7-9351-41a0-b6b0-678bf0ec3b86]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2723c6ea-c897-4eb7-b529-dbc3d855e79a]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ebf188-324e-4917-9ca9-fc3f3f733a75]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[805dc82b-d2ec-42c0-bd54-32a976dfaa5b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46, portal: 172.16.0.220,3260]
Dec 01 14:06:15 user nova-compute[75288]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46, portal: 172.16.0.220,3260] successful.
Dec 01 14:06:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d510cdc-e48d-41c9-aaa5-390926cbad46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79d8ca9-75cf-4d24-b923-4e55ae939775]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== disconnect_volume: return (302ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:06:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:06:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:06:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fa2ac911-71d2-4d75-89c0-e9dfb33152fd tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.887s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:18 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:20 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:06:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:06:23 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8222MB free_disk=24.853527069091797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a0ae420-3d13-48e9-88fa-432b97c27a28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 4be22849-cc7f-4d2c-a164-64b5f9e209f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 9ae651bf-c461-46e1-bc89-182740d6fe04 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:06:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:06:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:06:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:33 user nova-compute[75288]: INFO nova.compute.manager [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Detaching volume 849575bf-c6fa-4ad5-9c53-14e4823b64bb
Dec 01 14:06:33 user nova-compute[75288]: INFO nova.virt.block_device [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Attempting to driver detach volume 849575bf-c6fa-4ad5-9c53-14e4823b64bb from mountpoint /dev/vdb
Dec 01 14:06:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Attempting to detach device vdb from instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:06:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:06:33 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:06:33 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 14:06:33 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:06:33 user nova-compute[75288]:   <serial>849575bf-c6fa-4ad5-9c53-14e4823b64bb</serial>
Dec 01 14:06:33 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 14:06:33 user nova-compute[75288]: </disk>
Dec 01 14:06:33 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:06:33 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully detached device vdb from instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 from the persistent domain config.
Dec 01 14:06:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:06:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:06:33 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:06:33 user nova-compute[75288]:   <source dev="/dev/sde"/>
Dec 01 14:06:33 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:06:33 user nova-compute[75288]:   <serial>849575bf-c6fa-4ad5-9c53-14e4823b64bb</serial>
Dec 01 14:06:33 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 14:06:33 user nova-compute[75288]: </disk>
Dec 01 14:06:33 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:06:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:37 user nova-compute[75288]: INFO nova.compute.manager [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Terminating instance
Dec 01 14:06:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-67a48632-586c-4f12-8f42-1a1630ffd8b7 req-b6b40cf6-c449-43f8-aef6-5d324284545b service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-unplugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67a48632-586c-4f12-8f42-1a1630ffd8b7 req-b6b40cf6-c449-43f8-aef6-5d324284545b service nova] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67a48632-586c-4f12-8f42-1a1630ffd8b7 req-b6b40cf6-c449-43f8-aef6-5d324284545b service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-67a48632-586c-4f12-8f42-1a1630ffd8b7 req-b6b40cf6-c449-43f8-aef6-5d324284545b service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-67a48632-586c-4f12-8f42-1a1630ffd8b7 req-b6b40cf6-c449-43f8-aef6-5d324284545b service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] No waiting events found dispatching network-vif-unplugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-67a48632-586c-4f12-8f42-1a1630ffd8b7 req-b6b40cf6-c449-43f8-aef6-5d324284545b service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-unplugged-84c070b9-aa68-466b-adc9-dc6f190937a2 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:06:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Instance destroyed successfully.
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lazy-loading 'resources' on Instance uuid 9ae651bf-c461-46e1-bc89-182740d6fe04 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:00:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2061549974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2061549974',id=39,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLGZoVn8wo0j+HxWvdZGonHfTRdvBPEtxiw/UmPhkHaSaiKgn4cKu/pEbtMUPTDSXF0UFybWDDxrt/bhvYTH/kmRQDBt0bxFDQBvzI3cxxc/MM2LRFwALn05z402ouZnQ==',key_name='tempest-keypair-1949436941',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:04:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ab4adede7a473d9b75844aa0d9da42',ramdisk_id='',reservation_id='r-5toak1n5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-548010779',owner_user_name='tempest-AttachVolumeShelveTestJSON-548010779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d51f494066a46c1b7fe1ed789318010',uuid=9ae651bf-c461-46e1-bc89-182740d6fe04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converting VIF {"id": "84c070b9-aa68-466b-adc9-dc6f190937a2", "address": "fa:16:3e:c5:3b:b7", "network": {"id": "8280367b-0f9e-45c9-aa32-de9a70ab21f2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-826098805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ab4adede7a473d9b75844aa0d9da42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c070b9-aa", "ovs_interfaceid": "84c070b9-aa68-466b-adc9-dc6f190937a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG os_vif [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c070b9-aa, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61181f2d-0ae6-4731-8bb8-bf593b0a3458) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:38 user nova-compute[75288]: INFO os_vif [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:3b:b7,bridge_name='br-int',has_traffic_filtering=True,id=84c070b9-aa68-466b-adc9-dc6f190937a2,network=Network(8280367b-0f9e-45c9-aa32-de9a70ab21f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c070b9-aa')
Dec 01 14:06:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Deleting instance files /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04_del
Dec 01 14:06:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Deletion of /opt/stack/data/nova/instances/9ae651bf-c461-46e1-bc89-182740d6fe04_del complete
Dec 01 14:06:38 user nova-compute[75288]: INFO nova.compute.manager [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 01 14:06:38 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:06:38 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:06:39 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:06:39 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Took 0.63 seconds to deallocate network for instance.
Dec 01 14:06:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-9198fc73-1959-426e-b7c5-b28125d4bbcb req-630c9a91-2a0c-4c77-9451-2f0f8f5d4068 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-deleted-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:06:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:39 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:06:39 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:06:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:39 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Deleted allocations for instance 9ae651bf-c461-46e1-bc89-182740d6fe04
Dec 01 14:06:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ee23be94-eae2-4180-956c-6260c9cfeadf tempest-AttachVolumeShelveTestJSON-548010779 tempest-AttachVolumeShelveTestJSON-548010779-project-member] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.974s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-eee4637e-437e-4f34-9dba-4221e1272085 req-772ea27d-94fb-4520-8a37-4a7fc2f01260 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:06:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eee4637e-437e-4f34-9dba-4221e1272085 req-772ea27d-94fb-4520-8a37-4a7fc2f01260 service nova] Acquiring lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eee4637e-437e-4f34-9dba-4221e1272085 req-772ea27d-94fb-4520-8a37-4a7fc2f01260 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eee4637e-437e-4f34-9dba-4221e1272085 req-772ea27d-94fb-4520-8a37-4a7fc2f01260 service nova] Lock "9ae651bf-c461-46e1-bc89-182740d6fe04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-eee4637e-437e-4f34-9dba-4221e1272085 req-772ea27d-94fb-4520-8a37-4a7fc2f01260 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] No waiting events found dispatching network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:06:40 user nova-compute[75288]: WARNING nova.compute.manager [req-eee4637e-437e-4f34-9dba-4221e1272085 req-772ea27d-94fb-4520-8a37-4a7fc2f01260 service nova] [instance: 9ae651bf-c461-46e1-bc89-182740d6fe04] Received unexpected event network-vif-plugged-84c070b9-aa68-466b-adc9-dc6f190937a2 for instance with vm_state deleted and task_state None.
Dec 01 14:06:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:47 user nova-compute[75288]: INFO nova.compute.manager [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Terminating instance
Dec 01 14:06:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-c38afc42-b5c5-470c-878d-ff21e3f524ef req-f42f218e-b6db-475b-a9ae-68e2f6b6b74d service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received event network-vif-unplugged-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c38afc42-b5c5-470c-878d-ff21e3f524ef req-f42f218e-b6db-475b-a9ae-68e2f6b6b74d service nova] Acquiring lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c38afc42-b5c5-470c-878d-ff21e3f524ef req-f42f218e-b6db-475b-a9ae-68e2f6b6b74d service nova] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c38afc42-b5c5-470c-878d-ff21e3f524ef req-f42f218e-b6db-475b-a9ae-68e2f6b6b74d service nova] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-c38afc42-b5c5-470c-878d-ff21e3f524ef req-f42f218e-b6db-475b-a9ae-68e2f6b6b74d service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] No waiting events found dispatching network-vif-unplugged-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-c38afc42-b5c5-470c-878d-ff21e3f524ef req-f42f218e-b6db-475b-a9ae-68e2f6b6b74d service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received event network-vif-unplugged-283c4c88-4aa8-4933-9147-8510f5b381d5 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:47 user nova-compute[75288]: INFO nova.compute.manager [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attaching volume 0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 to /dev/vdb
Dec 01 14:06:47 user nova-compute[75288]: DEBUG os_brick.utils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dd523e-c8a9-4bfe-a2d9-5171a606fba6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcc658a-d023-48e1-a3ca-4e687fbae679]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efe16ce-6dfe-4a44-9cfd-677c38e18d57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e92a43f-11fd-4d0b-a94f-dca14d809f7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:06:47 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:06:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be393a1-8c26-4cea-be3f-2e719fcbe650]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG os_brick.utils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating existing volume attachment record: c045b331-03c6-4342-8343-7425024f4233 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:06:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Instance destroyed successfully.
Dec 01 14:06:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'resources' on Instance uuid 8a0ae420-3d13-48e9-88fa-432b97c27a28 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:57:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1794077369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1794077369',id=34,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:57:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-lgkqtiu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:59:21Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=8a0ae420-3d13-48e9-88fa-432b97c27a28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "283c4c88-4aa8-4933-9147-8510f5b381d5", "address": "fa:16:3e:ca:be:25", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap283c4c88-4a", "ovs_interfaceid": "283c4c88-4aa8-4933-9147-8510f5b381d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:be:25,bridge_name='br-int',has_traffic_filtering=True,id=283c4c88-4aa8-4933-9147-8510f5b381d5,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4c88-4a') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG os_vif [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:be:25,bridge_name='br-int',has_traffic_filtering=True,id=283c4c88-4aa8-4933-9147-8510f5b381d5,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4c88-4a') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap283c4c88-4a, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef1c0afd-2ef3-416a-959a-4d51aa69f5e7) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:48 user nova-compute[75288]: INFO os_vif [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:be:25,bridge_name='br-int',has_traffic_filtering=True,id=283c4c88-4aa8-4933-9147-8510f5b381d5,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap283c4c88-4a')
Dec 01 14:06:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Deleting instance files /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28_del
Dec 01 14:06:48 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Deletion of /opt/stack/data/nova/instances/8a0ae420-3d13-48e9-88fa-432b97c27a28_del complete
Dec 01 14:06:48 user nova-compute[75288]: INFO nova.compute.manager [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Took 0.98 seconds to destroy the instance on the hypervisor.
Dec 01 14:06:48 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:06:48 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Took 0.43 seconds to deallocate network for instance.
Dec 01 14:06:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:48 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:06:49 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:06:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:49 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Deleted allocations for instance 8a0ae420-3d13-48e9-88fa-432b97c27a28
Dec 01 14:06:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b82ecbbe-6430-4f46-bab7-a300aa852944 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.825s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-e05f3865-13b7-4486-8ce6-985fbf16006a req-f4a560ad-eb61-4524-9a1f-72e044993352 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received event network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:06:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e05f3865-13b7-4486-8ce6-985fbf16006a req-f4a560ad-eb61-4524-9a1f-72e044993352 service nova] Acquiring lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e05f3865-13b7-4486-8ce6-985fbf16006a req-f4a560ad-eb61-4524-9a1f-72e044993352 service nova] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e05f3865-13b7-4486-8ce6-985fbf16006a req-f4a560ad-eb61-4524-9a1f-72e044993352 service nova] Lock "8a0ae420-3d13-48e9-88fa-432b97c27a28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-e05f3865-13b7-4486-8ce6-985fbf16006a req-f4a560ad-eb61-4524-9a1f-72e044993352 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] No waiting events found dispatching network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:06:49 user nova-compute[75288]: WARNING nova.compute.manager [req-e05f3865-13b7-4486-8ce6-985fbf16006a req-f4a560ad-eb61-4524-9a1f-72e044993352 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received unexpected event network-vif-plugged-283c4c88-4aa8-4933-9147-8510f5b381d5 for instance with vm_state deleted and task_state None.
Dec 01 14:06:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-e05f3865-13b7-4486-8ce6-985fbf16006a req-f4a560ad-eb61-4524-9a1f-72e044993352 service nova] [instance: 8a0ae420-3d13-48e9-88fa-432b97c27a28] Received event network-vif-deleted-283c4c88-4aa8-4933-9147-8510f5b381d5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:06:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 is timed out.
Dec 01 14:06:54 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully detached device vdb from instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 from the live domain config.
Dec 01 14:06:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARBrkwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:06:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9302c57f-5c79-41e7-ab03-674a6fc6e863]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:06:54 user nova-compute[75288]: No targets found.
Dec 01 14:06:54 user nova-compute[75288]: iSNS:
Dec 01 14:06:54 user nova-compute[75288]: No targets found.
Dec 01 14:06:54 user nova-compute[75288]: STATIC:
Dec 01 14:06:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:06:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:06:54 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:06:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d
Dec 01 14:06:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:06:54 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:06:54 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb
Dec 01 14:06:54 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:06:54 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:06:54 user nova-compute[75288]: FIRMWARE:
Dec 01 14:06:54 user nova-compute[75288]: No targets found.
Dec 01 14:06:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:06:54 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:06:54 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf64efe3-a752-449c-a03c-44e17aedff7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[031be965-dde2-4322-bc86-046d1161c7f8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:06:54 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:06:54 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:06:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:06:54 user nova-compute[75288]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb (non-flash)
Dec 01 14:06:54 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:06:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ee28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb'): ({'sde'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Removing single pathed devices sde {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ed3b90-868e-4c97-afc4-b6031571c304]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7e1bc2-545c-4619-a901-8d3b980dbe51]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flushing IO for device /dev/sde {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2084ca-3e96-4a59-80fb-4efc2450efb4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d128e6c-5b53-47ff-ae38-cb64902ccefa]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] SCSI volumes sde have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef1eaa-583f-4e3a-bad6-1341629a49a5]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[716378e0-ecf3-425d-9a0a-c04445892757]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260]
Dec 01 14:06:54 user nova-compute[75288]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb, portal: 172.16.0.220,3260] successful.
Dec 01 14:06:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:849575bf-c6fa-4ad5-9c53-14e4823b64bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[379813b5-a0ac-4ec6-8eb6-f53ceb4989fa]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== disconnect_volume: return (275ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:06:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:06:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:06:55 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8679bdc-656c-4b13-91f1-10e2edd56fda tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ab9c3c1-8319-4362-9ad2-1137eeeb0586 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ab9c3c1-8319-4362-9ad2-1137eeeb0586 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ab9c3c1-8319-4362-9ad2-1137eeeb0586 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ab9c3c1-8319-4362-9ad2-1137eeeb0586 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75288) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7ab9c3c1-8319-4362-9ad2-1137eeeb0586 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-2367a2a2-a720-432b-9468-a54a89ad9040 req-91001680-dcd9-4835-9b18-77a4f829de54 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2367a2a2-a720-432b-9468-a54a89ad9040 req-91001680-dcd9-4835-9b18-77a4f829de54 service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2367a2a2-a720-432b-9468-a54a89ad9040 req-91001680-dcd9-4835-9b18-77a4f829de54 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2367a2a2-a720-432b-9468-a54a89ad9040 req-91001680-dcd9-4835-9b18-77a4f829de54 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-2367a2a2-a720-432b-9468-a54a89ad9040 req-91001680-dcd9-4835-9b18-77a4f829de54 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:06:56 user nova-compute[75288]: WARNING nova.compute.manager [req-2367a2a2-a720-432b-9468-a54a89ad9040 req-91001680-dcd9-4835-9b18-77a4f829de54 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state active and task_state powering-off.
Dec 01 14:06:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance destroyed successfully.
Dec 01 14:06:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7ab9c3c1-8319-4362-9ad2-1137eeeb0586 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7ab9c3c1-8319-4362-9ad2-1137eeeb0586 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.819s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzhVSlbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:06:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:06:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:06:57 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94b42e5-1712-453f-92bb-a9aebda90fec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:06:57 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[428bdc1b-e6d5-43f9-94d4-c8fff8d84f8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7] added
Dec 01 14:06:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[015c76a3-beb5-4cd6-8052-1adf834dccb4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1505b56f-48b4-4f00-8e8c-4290d7360e05]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzhVSlbd {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzhVSlbd" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3bf061-bf4c-42c7-8050-0045e0468ade]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RzhVSlbd'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[885de21d-9716-4840-9897-f23dd5b134cf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9891a60-fc27-40d5-b5c2-b87847e897f1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:06:57 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:06:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:06:57 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:06:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d27feb-9ac4-418a-b759-2dc7043209b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7, portal: 172.16.0.220,3260]
Dec 01 14:06:57 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7, portal: 172.16.0.220,3260] successful.
Dec 01 14:06:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee8587-4d5e-4f78-b10e-495321a5040a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2252a0-89ad-4632-9b53-fdc3b0f997c3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:06:57 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:06:57 user nova-compute[75288]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)
Dec 01 14:06:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:06:57 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:06:57 user nova-compute[75288]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)
Dec 01 14:06:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a89e687-36b5-49e4-af4e-e2fefffde458]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:06:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzhVSlbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23635383463363566', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635383463363566', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:06:58 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:06:58 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:06:58 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:06:58 user nova-compute[75288]:   <serial>0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7</serial>
Dec 01 14:06:58 user nova-compute[75288]: </disk>
Dec 01 14:06:58 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-706d9c40-21b4-4725-8129-de602336556c req-9cf600d0-f624-40c1-84d5-e0f0161c13a2 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-706d9c40-21b4-4725-8129-de602336556c req-9cf600d0-f624-40c1-84d5-e0f0161c13a2 service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-706d9c40-21b4-4725-8129-de602336556c req-9cf600d0-f624-40c1-84d5-e0f0161c13a2 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-706d9c40-21b4-4725-8129-de602336556c req-9cf600d0-f624-40c1-84d5-e0f0161c13a2 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:06:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-706d9c40-21b4-4725-8129-de602336556c req-9cf600d0-f624-40c1-84d5-e0f0161c13a2 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:06:58 user nova-compute[75288]: WARNING nova.compute.manager [req-706d9c40-21b4-4725-8129-de602336556c req-9cf600d0-f624-40c1-84d5-e0f0161c13a2 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state stopped and task_state None.
Dec 01 14:06:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:06:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:06:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No VIF found with MAC fa:16:3e:7c:b8:ac, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:06:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-8ba84062-8fc4-41ab-89ab-f5e2a706efce tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.478s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:01 user nova-compute[75288]: INFO nova.compute.manager [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Detaching volume 0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7
Dec 01 14:07:01 user nova-compute[75288]: INFO nova.virt.block_device [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attempting to driver detach volume 0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 from mountpoint /dev/vdb
Dec 01 14:07:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Attempting to detach device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:07:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:07:01 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:07:01 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:07:01 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:07:01 user nova-compute[75288]:   <serial>0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7</serial>
Dec 01 14:07:01 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:07:01 user nova-compute[75288]: </disk>
Dec 01 14:07:01 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:07:01 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully detached device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the persistent domain config.
Dec 01 14:07:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:07:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:07:01 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:07:01 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:07:01 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:07:01 user nova-compute[75288]:   <serial>0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7</serial>
Dec 01 14:07:01 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:07:01 user nova-compute[75288]: </disk>
Dec 01 14:07:01 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:07:01 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:07:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:07:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:07:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:07:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:13 user nova-compute[75288]: INFO nova.compute.manager [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Terminating instance
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fcf28d0-07f7-4baa-aa1c-ef3a30ff2fcb req-04023ad0-cf10-4668-bd69-00ad087ef045 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-unplugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fcf28d0-07f7-4baa-aa1c-ef3a30ff2fcb req-04023ad0-cf10-4668-bd69-00ad087ef045 service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fcf28d0-07f7-4baa-aa1c-ef3a30ff2fcb req-04023ad0-cf10-4668-bd69-00ad087ef045 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7fcf28d0-07f7-4baa-aa1c-ef3a30ff2fcb req-04023ad0-cf10-4668-bd69-00ad087ef045 service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fcf28d0-07f7-4baa-aa1c-ef3a30ff2fcb req-04023ad0-cf10-4668-bd69-00ad087ef045 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] No waiting events found dispatching network-vif-unplugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-7fcf28d0-07f7-4baa-aa1c-ef3a30ff2fcb req-04023ad0-cf10-4668-bd69-00ad087ef045 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-unplugged-13c76a3f-58ea-4c3e-a668-d0951601b610 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:07:13 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Instance destroyed successfully.
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lazy-loading 'resources' on Instance uuid 4be22849-cc7f-4d2c-a164-64b5f9e209f8 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-610581160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1482792749',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHc7FfvG1tx1bhwWaV0yEVXohOMyaxsQiapAzm0VI2IldJ/xYPeLxsqGNLjT+nDVD7q/i7w42TB7DdWiOaxUi1lxBE/jXsx6YaiFWJlQOTRIY16v61SJk+LkCAuS6vCezQ==',key_name='tempest-keypair-1123464944',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:05:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='538347059fc54fb9a5da690fa138daae',ramdisk_id='',reservation_id='r-s1m2c1jd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-491583892',owner_user_name='tempest-ServerActionsV293TestJSON-491583892-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c3fc71e453145b3bba513c6bed1db09',uuid=4be22849-cc7f-4d2c-a164-64b5f9e209f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converting VIF {"id": "13c76a3f-58ea-4c3e-a668-d0951601b610", "address": "fa:16:3e:48:ba:8c", "network": {"id": "d002d530-a45a-4e8c-a5bf-b5a07a93e719", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1537546934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "538347059fc54fb9a5da690fa138daae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c76a3f-58", "ovs_interfaceid": "13c76a3f-58ea-4c3e-a668-d0951601b610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_vif [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13c76a3f-58, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4ddc7dc-f3b4-49da-bae2-5d16adfeeb5e) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:13 user nova-compute[75288]: INFO os_vif [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ba:8c,bridge_name='br-int',has_traffic_filtering=True,id=13c76a3f-58ea-4c3e-a668-d0951601b610,network=Network(d002d530-a45a-4e8c-a5bf-b5a07a93e719),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c76a3f-58')
Dec 01 14:07:13 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhSHQaWp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:07:13 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cc7be6-bc14-47c1-8101-d2c708bb0766]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:07:13 user nova-compute[75288]: No targets found.
Dec 01 14:07:13 user nova-compute[75288]: iSNS:
Dec 01 14:07:13 user nova-compute[75288]: No targets found.
Dec 01 14:07:13 user nova-compute[75288]: STATIC:
Dec 01 14:07:13 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:07:13 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:07:13 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:07:13 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d
Dec 01 14:07:13 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:07:13 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:07:13 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7
Dec 01 14:07:13 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:07:13 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:07:13 user nova-compute[75288]: FIRMWARE:
Dec 01 14:07:13 user nova-compute[75288]: No targets found.
Dec 01 14:07:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:07:13 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:07:13 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2ddc22-9bf4-4817-83d9-2c02747e7224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc9ae67-6c3f-4518-bd7b-f8b17d44ec15]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:07:13 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:07:13 user nova-compute[75288]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)
Dec 01 14:07:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:07:13 user nova-compute[75288]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d (non-flash)
Dec 01 14:07:13 user nova-compute[75288]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)
Dec 01 14:07:13 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e88d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d'): ({'sdf'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Removing single pathed devices sdf {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:07:13 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a725ec-5dd5-461b-b5ee-3c2094cc9572]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda1e16-db84-4638-aadb-4e7604acda65]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Flushing IO for device /dev/sdf {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a28ca8-f0be-442b-81e7-81ee28ac5ea1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e775e2-e1b5-407b-a675-3a0848f9683e]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] SCSI volumes sdf have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_535d420', '/dev/disk/by-id/scsi-26635393438393965', '/dev/disk/by-id/scsi-1SCST_BIO535d420-f594899e4ee5fe78') {{(pid=86480) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59d4323-ae8d-4041-a807-06854d1ab42b]: (4, None) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9dfe50-b106-405e-8520-2c34ef00f572]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.146s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[09567e53-2ee2-4458-a2fd-9985ab2aae9e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260]
Dec 01 14:07:14 user nova-compute[75288]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d, portal: 172.16.0.220,3260] successful.
Dec 01 14:07:14 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:469e7cb7-71e7-499d-b092-6c9182578f0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c1b13b-d7e5-4147-b655-a280429268c9]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] <== disconnect_volume: return (403ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:07:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Deleting instance files /opt/stack/data/nova/instances/4be22849-cc7f-4d2c-a164-64b5f9e209f8_del
Dec 01 14:07:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Deletion of /opt/stack/data/nova/instances/4be22849-cc7f-4d2c-a164-64b5f9e209f8_del complete
Dec 01 14:07:14 user nova-compute[75288]: INFO nova.compute.manager [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Took 1.26 seconds to destroy the instance on the hypervisor.
Dec 01 14:07:14 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:07:14 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:07:15 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Took 0.64 seconds to deallocate network for instance.
Dec 01 14:07:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-c723eee6-823d-49f3-8296-325778a58577 req-9e09e86e-471d-4c61-bed6-5b8ac9165b72 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-deleted-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:07:15 user nova-compute[75288]: INFO nova.compute.manager [req-c723eee6-823d-49f3-8296-325778a58577 req-9e09e86e-471d-4c61-bed6-5b8ac9165b72 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Neutron deleted interface 13c76a3f-58ea-4c3e-a668-d0951601b610; detaching it from the instance and deleting it from the info cache
Dec 01 14:07:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-c723eee6-823d-49f3-8296-325778a58577 req-9e09e86e-471d-4c61-bed6-5b8ac9165b72 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:07:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-c723eee6-823d-49f3-8296-325778a58577 req-9e09e86e-471d-4c61-bed6-5b8ac9165b72 service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Detach interface failed, port_id=13c76a3f-58ea-4c3e-a668-d0951601b610, reason: Instance 4be22849-cc7f-4d2c-a164-64b5f9e209f8 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:07:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-05a74560-48d4-4bf9-91b2-f9f54cbe86f7 req-c98506ce-b66b-4d8f-915b-2355f1fffffe service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:07:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-05a74560-48d4-4bf9-91b2-f9f54cbe86f7 req-c98506ce-b66b-4d8f-915b-2355f1fffffe service nova] Acquiring lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-05a74560-48d4-4bf9-91b2-f9f54cbe86f7 req-c98506ce-b66b-4d8f-915b-2355f1fffffe service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-05a74560-48d4-4bf9-91b2-f9f54cbe86f7 req-c98506ce-b66b-4d8f-915b-2355f1fffffe service nova] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-05a74560-48d4-4bf9-91b2-f9f54cbe86f7 req-c98506ce-b66b-4d8f-915b-2355f1fffffe service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] No waiting events found dispatching network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:07:15 user nova-compute[75288]: WARNING nova.compute.manager [req-05a74560-48d4-4bf9-91b2-f9f54cbe86f7 req-c98506ce-b66b-4d8f-915b-2355f1fffffe service nova] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Received unexpected event network-vif-plugged-13c76a3f-58ea-4c3e-a668-d0951601b610 for instance with vm_state active and task_state deleting.
Dec 01 14:07:15 user nova-compute[75288]: INFO nova.compute.manager [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Took 0.79 seconds to detach 1 volumes for instance.
Dec 01 14:07:15 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] [instance: 4be22849-cc7f-4d2c-a164-64b5f9e209f8] Deleting volume: 469e7cb7-71e7-499d-b092-6c9182578f0d {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 14:07:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:07:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:07:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:16 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Deleted allocations for instance 4be22849-cc7f-4d2c-a164-64b5f9e209f8
Dec 01 14:07:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e619686-fdfb-4538-b98b-ff725de8c5a7 tempest-ServerActionsV293TestJSON-491583892 tempest-ServerActionsV293TestJSON-491583892-project-member] Lock "4be22849-cc7f-4d2c-a164-64b5f9e209f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f is timed out.
Dec 01 14:07:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully detached device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the live domain config.
Dec 01 14:07:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzhVSlbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:07:21 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b610f03-3a65-400e-81d2-206267205493]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:07:21 user nova-compute[75288]: No targets found.
Dec 01 14:07:21 user nova-compute[75288]: iSNS:
Dec 01 14:07:21 user nova-compute[75288]: No targets found.
Dec 01 14:07:21 user nova-compute[75288]: STATIC:
Dec 01 14:07:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:07:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:07:21 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:07:21 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7
Dec 01 14:07:21 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:07:21 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:07:21 user nova-compute[75288]: FIRMWARE:
Dec 01 14:07:21 user nova-compute[75288]: No targets found.
Dec 01 14:07:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:07:21 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:07:21 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c220cfc-5024-490f-9e55-9deab3bb0bd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e31acf-4f94-41a6-ad9d-581b0f0c180a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:07:21 user nova-compute[75288]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)
Dec 01 14:07:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:07:21 user nova-compute[75288]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 (non-flash)
Dec 01 14:07:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc5aa9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3057f5-5762-42fd-b5f5-2a46dc12b701]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8156506e-f0da-44cf-babf-bb9ee1baca5c]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf61fb-682e-4131-8790-9c88ee742109]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b6a6cf-d4c6-4714-bbb7-084640dc10ee]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf87538-518c-4a1c-9930-a717f3fea3bb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0735f9c6-a577-44b3-aaa7-0b2c2fdcfe45]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7, portal: 172.16.0.220,3260]
Dec 01 14:07:21 user nova-compute[75288]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7, portal: 172.16.0.220,3260] successful.
Dec 01 14:07:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a60aa2b-963f-4a22-9fd6-0c2e6da5c8a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02cab2b-cec2-449a-8f73-57f1ecbf0daa]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== disconnect_volume: return (360ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:07:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:07:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:07:22 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:07:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=25.005023956298828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b7eac240-a923-4998-bfeb-e0a5dc37289e tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.990s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e38d99ed-efd9-4222-aaae-b06934bfac06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating instance_info_cache with network_info: [{"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:07:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:07:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:07:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:07:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:07:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:07:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:37 user nova-compute[75288]: INFO nova.compute.manager [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Terminating instance
Dec 01 14:07:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-0ba3601e-ae82-4f5b-9420-87b4261626a8 req-98f987cc-c29e-4247-9b3b-9af013ba99c4 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0ba3601e-ae82-4f5b-9420-87b4261626a8 req-98f987cc-c29e-4247-9b3b-9af013ba99c4 service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0ba3601e-ae82-4f5b-9420-87b4261626a8 req-98f987cc-c29e-4247-9b3b-9af013ba99c4 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0ba3601e-ae82-4f5b-9420-87b4261626a8 req-98f987cc-c29e-4247-9b3b-9af013ba99c4 service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-0ba3601e-ae82-4f5b-9420-87b4261626a8 req-98f987cc-c29e-4247-9b3b-9af013ba99c4 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-0ba3601e-ae82-4f5b-9420-87b4261626a8 req-98f987cc-c29e-4247-9b3b-9af013ba99c4 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-unplugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Instance destroyed successfully.
Dec 01 14:07:38 user nova-compute[75288]: DEBUG nova.objects.instance [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'resources' on Instance uuid e38d99ed-efd9-4222-aaae-b06934bfac06 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:51:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-869445862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-869445862',id=27,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:53:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-bou0lhif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:55:37Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=e38d99ed-efd9-4222-aaae-b06934bfac06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "address": "fa:16:3e:45:44:61", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf72b948-d7", "ovs_interfaceid": "bf72b948-d727-4c36-af5f-57b0b21b2d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:44:61,bridge_name='br-int',has_traffic_filtering=True,id=bf72b948-d727-4c36-af5f-57b0b21b2d4c,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf72b948-d7') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_vif [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:44:61,bridge_name='br-int',has_traffic_filtering=True,id=bf72b948-d727-4c36-af5f-57b0b21b2d4c,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf72b948-d7') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf72b948-d7, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70654219-541a-46a0-8331-ecadc2d878b3) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:38 user nova-compute[75288]: INFO os_vif [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:44:61,bridge_name='br-int',has_traffic_filtering=True,id=bf72b948-d727-4c36-af5f-57b0b21b2d4c,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf72b948-d7')
Dec 01 14:07:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekPXMDlg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:07:38 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97604cc2-d382-4383-aa33-b64d7ccdf236]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:07:38 user nova-compute[75288]: No targets found.
Dec 01 14:07:38 user nova-compute[75288]: iSNS:
Dec 01 14:07:38 user nova-compute[75288]: No targets found.
Dec 01 14:07:38 user nova-compute[75288]: STATIC:
Dec 01 14:07:38 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f
Dec 01 14:07:38 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:07:38 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:07:38 user nova-compute[75288]: FIRMWARE:
Dec 01 14:07:38 user nova-compute[75288]: No targets found.
Dec 01 14:07:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:07:38 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:07:38 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[46110fa3-a9c1-48df-b374-5d7eae484856]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8a3345-3e6c-44dd-bb32-ca1d3885fe00]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:07:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f (non-flash)
Dec 01 14:07:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e8ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[562bbb75-6823-475f-980e-9eb3b2021fe7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[557f6bc6-099e-4e82-b87f-95c49bad63a6]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4093ec-1496-4772-95cb-78bab7df8a21]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:07:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bee6bc5-154d-45cd-84b5-4fa83dd9773e]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a2b9b1-6e42-4b77-982e-575923f2423d]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fcb9ce-fc75-4cb9-ab7b-6957e18f2343]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f, portal: 172.16.0.220,3260]
Dec 01 14:07:39 user nova-compute[75288]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f, portal: 172.16.0.220,3260] successful.
Dec 01 14:07:39 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc17edfe-3a58-4536-bcc4-9419c41d4f2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[325b373f-fbab-470f-833c-1704ae84a18e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] <== disconnect_volume: return (315ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:07:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Deleting instance files /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06_del
Dec 01 14:07:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Deletion of /opt/stack/data/nova/instances/e38d99ed-efd9-4222-aaae-b06934bfac06_del complete
Dec 01 14:07:39 user nova-compute[75288]: INFO nova.compute.manager [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Took 1.26 seconds to destroy the instance on the hypervisor.
Dec 01 14:07:39 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:07:39 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:07:39 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Took 0.54 seconds to deallocate network for instance.
Dec 01 14:07:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-b87ffcc3-1942-4ff2-ab6d-51bc8cdc7102 req-8a863dd3-3158-47c9-a4f7-0953ac9a5404 service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-deleted-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-763cacd6-72bb-4f01-8542-760915a6569f req-a284d89d-d5b4-4d6d-9d64-b691fd3d32ea service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-763cacd6-72bb-4f01-8542-760915a6569f req-a284d89d-d5b4-4d6d-9d64-b691fd3d32ea service nova] Acquiring lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-763cacd6-72bb-4f01-8542-760915a6569f req-a284d89d-d5b4-4d6d-9d64-b691fd3d32ea service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-763cacd6-72bb-4f01-8542-760915a6569f req-a284d89d-d5b4-4d6d-9d64-b691fd3d32ea service nova] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-763cacd6-72bb-4f01-8542-760915a6569f req-a284d89d-d5b4-4d6d-9d64-b691fd3d32ea service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] No waiting events found dispatching network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:07:40 user nova-compute[75288]: WARNING nova.compute.manager [req-763cacd6-72bb-4f01-8542-760915a6569f req-a284d89d-d5b4-4d6d-9d64-b691fd3d32ea service nova] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Received unexpected event network-vif-plugged-bf72b948-d727-4c36-af5f-57b0b21b2d4c for instance with vm_state active and task_state deleting.
Dec 01 14:07:40 user nova-compute[75288]: INFO nova.compute.manager [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: e38d99ed-efd9-4222-aaae-b06934bfac06] Took 0.99 seconds to detach 1 volumes for instance.
Dec 01 14:07:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:40 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:07:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:41 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Deleted allocations for instance e38d99ed-efd9-4222-aaae-b06934bfac06
Dec 01 14:07:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-43111dde-bf17-4bf3-997f-6cf18f3a0ec6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "e38d99ed-efd9-4222-aaae-b06934bfac06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.170s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:07:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:07:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:07:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:07:54 user nova-compute[75288]: INFO nova.compute.manager [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attaching volume a16ee07a-c0be-42f9-9885-f068bd27c30e to /dev/vdb
Dec 01 14:07:54 user nova-compute[75288]: DEBUG os_brick.utils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[94125345-4421-4fc6-b3d1-dbaed37fdedc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a74b5b-1c87-4a09-b37c-56fcb2569be4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6cf5c7-68a1-487b-9853-f2a65340d9b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56cb990-cdcf-4a88-88f6-b7b06f77a607]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:07:54 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:07:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810cc1c-4b60-46df-87ed-fb734c25a92d]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG os_brick.utils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:07:54 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating existing volume attachment record: 31739adc-7f02-4957-9336-25edd59edf62 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:07:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:07:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQbiwBCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:08:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:08:02 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:08:02 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d16498-5aa6-44c8-adc8-6d93e147a664]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:08:02 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb79aed-fd4c-467c-bf85-16747f32a3a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e] added
Dec 01 14:08:02 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e54bff8-a3db-42ae-9002-a3f0eec6a2bc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a043dc-112c-43e5-8b38-7c8f78bfe19b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQbiwBCS {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQbiwBCS" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fede018-0850-40aa-a89d-2c1ef16aff50]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQbiwBCS'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:02 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c90887f-6c67-4344-8881-bc77a20ee7fc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c67f053-a018-42b4-b1f9-ae5169006db3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:08:03 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:08:03 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:08:03 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 14:08:03 user nova-compute[75288]: 
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a0d52-2efa-4774-80c4-e07019bffe64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e, portal: 172.16.0.220,3260]
Dec 01 14:08:03 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e, portal: 172.16.0.220,3260] successful.
Dec 01 14:08:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29bf6d4-6ffc-49e1-a080-fa8a313611f1]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db244f-ba07-4a95-914b-efe2b1b9358f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e (non-flash)
Dec 01 14:08:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e (non-flash)
Dec 01 14:08:03 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f013ebc1-11b0-41ba-bfe2-10cddcdef40e]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:08:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQbiwBCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23133383938353261', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133383938353261', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG nova.objects.instance [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:08:04 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:08:04 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:08:04 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:08:04 user nova-compute[75288]:   <serial>a16ee07a-c0be-42f9-9885-f068bd27c30e</serial>
Dec 01 14:08:04 user nova-compute[75288]: </disk>
Dec 01 14:08:04 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] No VIF found with MAC fa:16:3e:7c:b8:ac, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:08:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17e5d9f2-d7c6-49e4-bef1-c48a99557610 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.560s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:06 user nova-compute[75288]: INFO nova.compute.manager [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Detaching volume a16ee07a-c0be-42f9-9885-f068bd27c30e
Dec 01 14:08:06 user nova-compute[75288]: INFO nova.virt.block_device [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Attempting to driver detach volume a16ee07a-c0be-42f9-9885-f068bd27c30e from mountpoint /dev/vdb
Dec 01 14:08:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Attempting to detach device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:08:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:08:06 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:08:06 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:08:06 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:08:06 user nova-compute[75288]:   <serial>a16ee07a-c0be-42f9-9885-f068bd27c30e</serial>
Dec 01 14:08:06 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:08:06 user nova-compute[75288]: </disk>
Dec 01 14:08:06 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:08:06 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully detached device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the persistent domain config.
Dec 01 14:08:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:08:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:08:06 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:08:06 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:08:06 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:08:06 user nova-compute[75288]:   <serial>a16ee07a-c0be-42f9-9885-f068bd27c30e</serial>
Dec 01 14:08:06 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:08:06 user nova-compute[75288]: </disk>
Dec 01 14:08:06 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:08:07 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:08:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:16 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:08:16 user nova-compute[75288]: INFO nova.compute.claims [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Claim successful on node user
Dec 01 14:08:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:08:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:08:17 user nova-compute[75288]: DEBUG nova.policy [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8674c9e9664e4122ae9966afdbebe365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6739624adb2547748e727a851ee65689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:08:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Creating image(s)
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "/opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "/opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "/opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Successfully created port: cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk 1073741824" returned: 0 in 0.050s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Cannot resize image /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Ensure instance console log exists: /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Successfully updated port: cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquired lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-47869c65-eca6-419f-86d6-cbe7f1a4fd18 req-c0225a36-5c3b-4bcc-b0df-f3a7b18e02b9 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received event network-changed-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-47869c65-eca6-419f-86d6-cbe7f1a4fd18 req-c0225a36-5c3b-4bcc-b0df-f3a7b18e02b9 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Refreshing instance network info cache due to event network-changed-cd6e5ca0-8656-4f7d-8679-931e3418984a. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-47869c65-eca6-419f-86d6-cbe7f1a4fd18 req-c0225a36-5c3b-4bcc-b0df-f3a7b18e02b9 service nova] Acquiring lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:18 user nova-compute[75288]: DEBUG nova.network.neutron [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updating instance_info_cache with network_info: [{"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Releasing lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Instance network_info: |[{"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-47869c65-eca6-419f-86d6-cbe7f1a4fd18 req-c0225a36-5c3b-4bcc-b0df-f3a7b18e02b9 service nova] Acquired lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-47869c65-eca6-419f-86d6-cbe7f1a4fd18 req-c0225a36-5c3b-4bcc-b0df-f3a7b18e02b9 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Refreshing network info cache for port cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Start _get_guest_xml network_info=[{"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:08:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:08:19 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-827723600',display_name='tempest-AttachVolumeNegativeTest-server-827723600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-827723600',id=42,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUkfsQX/m2vqtog4yk2lBhrNjh3tMjH67G2tUnJvLnYPyhZo5rEl9c8ImEX//MZt1WiRcgwtWgyMYJw6SJndVkeNNYhIv4RdTF+SaYEGeHWpDncu6EHtv+zxp4KOxke2A==',key_name='tempest-keypair-1865117686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-jvsuzue8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=29b2c407-8c8b-4722-8eec-b1dff1659960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0e:ac,bridge_name='br-int',has_traffic_filtering=True,id=cd6e5ca0-8656-4f7d-8679-931e3418984a,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6e5ca0-86') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'pci_devices' on Instance uuid 29b2c407-8c8b-4722-8eec-b1dff1659960 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:08:19 user nova-compute[75288]:   <uuid>29b2c407-8c8b-4722-8eec-b1dff1659960</uuid>
Dec 01 14:08:19 user nova-compute[75288]:   <name>instance-0000002a</name>
Dec 01 14:08:19 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:08:19 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:08:19 user nova-compute[75288]:   <metadata>
Dec 01 14:08:19 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:08:19 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:08:19 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeNegativeTest-server-827723600</nova:name>
Dec 01 14:08:19 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:08:19</nova:creationTime>
Dec 01 14:08:19 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:08:19 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:08:19 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:08:19 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:08:19 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:08:19 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:08:19 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:08:19 user nova-compute[75288]:       <nova:owner>
Dec 01 14:08:19 user nova-compute[75288]:         <nova:user uuid="8674c9e9664e4122ae9966afdbebe365">tempest-AttachVolumeNegativeTest-566842019-project-member</nova:user>
Dec 01 14:08:19 user nova-compute[75288]:         <nova:project uuid="6739624adb2547748e727a851ee65689">tempest-AttachVolumeNegativeTest-566842019</nova:project>
Dec 01 14:08:19 user nova-compute[75288]:       </nova:owner>
Dec 01 14:08:19 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:08:19 user nova-compute[75288]:       <nova:ports>
Dec 01 14:08:19 user nova-compute[75288]:         <nova:port uuid="cd6e5ca0-8656-4f7d-8679-931e3418984a">
Dec 01 14:08:19 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 14:08:19 user nova-compute[75288]:         </nova:port>
Dec 01 14:08:19 user nova-compute[75288]:       </nova:ports>
Dec 01 14:08:19 user nova-compute[75288]:     </nova:instance>
Dec 01 14:08:19 user nova-compute[75288]:   </metadata>
Dec 01 14:08:19 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:08:19 user nova-compute[75288]:     <system>
Dec 01 14:08:19 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:08:19 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:08:19 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:08:19 user nova-compute[75288]:       <entry name="serial">29b2c407-8c8b-4722-8eec-b1dff1659960</entry>
Dec 01 14:08:19 user nova-compute[75288]:       <entry name="uuid">29b2c407-8c8b-4722-8eec-b1dff1659960</entry>
Dec 01 14:08:19 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:08:19 user nova-compute[75288]:     </system>
Dec 01 14:08:19 user nova-compute[75288]:   </sysinfo>
Dec 01 14:08:19 user nova-compute[75288]:   <os>
Dec 01 14:08:19 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:08:19 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:08:19 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:08:19 user nova-compute[75288]:   </os>
Dec 01 14:08:19 user nova-compute[75288]:   <features>
Dec 01 14:08:19 user nova-compute[75288]:     <acpi/>
Dec 01 14:08:19 user nova-compute[75288]:     <apic/>
Dec 01 14:08:19 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:08:19 user nova-compute[75288]:   </features>
Dec 01 14:08:19 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:08:19 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:08:19 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:08:19 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:08:19 user nova-compute[75288]:   </clock>
Dec 01 14:08:19 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:08:19 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:08:19 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:08:19 user nova-compute[75288]:   </cpu>
Dec 01 14:08:19 user nova-compute[75288]:   <devices>
Dec 01 14:08:19 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:08:19 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:08:19 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk"/>
Dec 01 14:08:19 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:08:19 user nova-compute[75288]:     </disk>
Dec 01 14:08:19 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:08:19 user nova-compute[75288]:       <mac address="fa:16:3e:fd:0e:ac"/>
Dec 01 14:08:19 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:08:19 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:08:19 user nova-compute[75288]:       <target dev="tapcd6e5ca0-86"/>
Dec 01 14:08:19 user nova-compute[75288]:     </interface>
Dec 01 14:08:19 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:08:19 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/console.log" append="off"/>
Dec 01 14:08:19 user nova-compute[75288]:     </serial>
Dec 01 14:08:19 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:08:19 user nova-compute[75288]:     <video>
Dec 01 14:08:19 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:08:19 user nova-compute[75288]:     </video>
Dec 01 14:08:19 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:08:19 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:08:19 user nova-compute[75288]:     </rng>
Dec 01 14:08:19 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:08:19 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:08:19 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:08:19 user nova-compute[75288]:     </memballoon>
Dec 01 14:08:19 user nova-compute[75288]:   </devices>
Dec 01 14:08:19 user nova-compute[75288]: </domain>
Dec 01 14:08:19 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-827723600',display_name='tempest-AttachVolumeNegativeTest-server-827723600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-827723600',id=42,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUkfsQX/m2vqtog4yk2lBhrNjh3tMjH67G2tUnJvLnYPyhZo5rEl9c8ImEX//MZt1WiRcgwtWgyMYJw6SJndVkeNNYhIv4RdTF+SaYEGeHWpDncu6EHtv+zxp4KOxke2A==',key_name='tempest-keypair-1865117686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-jvsuzue8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=29b2c407-8c8b-4722-8eec-b1dff1659960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0e:ac,bridge_name='br-int',has_traffic_filtering=True,id=cd6e5ca0-8656-4f7d-8679-931e3418984a,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6e5ca0-86') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG os_vif [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0e:ac,bridge_name='br-int',has_traffic_filtering=True,id=cd6e5ca0-8656-4f7d-8679-931e3418984a,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6e5ca0-86') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30bca2f9-1f6a-53c2-82f6-662cead41965', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd6e5ca0-86, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd6e5ca0-86, col_values=(('qos', UUID('408cd298-412d-4999-a999-87425bcea1ff')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd6e5ca0-86, col_values=(('external_ids', {'iface-id': 'cd6e5ca0-8656-4f7d-8679-931e3418984a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:0e:ac', 'vm-uuid': '29b2c407-8c8b-4722-8eec-b1dff1659960'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:19 user nova-compute[75288]: INFO os_vif [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:0e:ac,bridge_name='br-int',has_traffic_filtering=True,id=cd6e5ca0-8656-4f7d-8679-931e3418984a,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6e5ca0-86')
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No VIF found with MAC fa:16:3e:fd:0e:ac, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-47869c65-eca6-419f-86d6-cbe7f1a4fd18 req-c0225a36-5c3b-4bcc-b0df-f3a7b18e02b9 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updated VIF entry in instance network info cache for port cd6e5ca0-8656-4f7d-8679-931e3418984a. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG nova.network.neutron [req-47869c65-eca6-419f-86d6-cbe7f1a4fd18 req-c0225a36-5c3b-4bcc-b0df-f3a7b18e02b9 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updating instance_info_cache with network_info: [{"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:08:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-47869c65-eca6-419f-86d6-cbe7f1a4fd18 req-c0225a36-5c3b-4bcc-b0df-f3a7b18e02b9 service nova] Releasing lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-2dd405a7-1ef3-4c31-b454-681385d479ca req-a506cf64-bd00-4a8e-ac02-93f72ed87c70 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received event network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2dd405a7-1ef3-4c31-b454-681385d479ca req-a506cf64-bd00-4a8e-ac02-93f72ed87c70 service nova] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2dd405a7-1ef3-4c31-b454-681385d479ca req-a506cf64-bd00-4a8e-ac02-93f72ed87c70 service nova] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2dd405a7-1ef3-4c31-b454-681385d479ca req-a506cf64-bd00-4a8e-ac02-93f72ed87c70 service nova] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-2dd405a7-1ef3-4c31-b454-681385d479ca req-a506cf64-bd00-4a8e-ac02-93f72ed87c70 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] No waiting events found dispatching network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:08:20 user nova-compute[75288]: WARNING nova.compute.manager [req-2dd405a7-1ef3-4c31-b454-681385d479ca req-a506cf64-bd00-4a8e-ac02-93f72ed87c70 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received unexpected event network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a for instance with vm_state building and task_state spawning.
Dec 01 14:08:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:08:22 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Instance spawned successfully.
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-6252a03f-42bb-4d65-bc2d-73f32209168d req-5ab32d35-fe75-4ed8-9237-3433f4d0c20c service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received event network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6252a03f-42bb-4d65-bc2d-73f32209168d req-5ab32d35-fe75-4ed8-9237-3433f4d0c20c service nova] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6252a03f-42bb-4d65-bc2d-73f32209168d req-5ab32d35-fe75-4ed8-9237-3433f4d0c20c service nova] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6252a03f-42bb-4d65-bc2d-73f32209168d req-5ab32d35-fe75-4ed8-9237-3433f4d0c20c service nova] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-6252a03f-42bb-4d65-bc2d-73f32209168d req-5ab32d35-fe75-4ed8-9237-3433f4d0c20c service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] No waiting events found dispatching network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:08:22 user nova-compute[75288]: WARNING nova.compute.manager [req-6252a03f-42bb-4d65-bc2d-73f32209168d req-5ab32d35-fe75-4ed8-9237-3433f4d0c20c service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received unexpected event network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a for instance with vm_state building and task_state spawning.
Dec 01 14:08:22 user nova-compute[75288]: INFO nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Took 5.06 seconds to spawn the instance on the hypervisor.
Dec 01 14:08:22 user nova-compute[75288]: DEBUG nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:08:22 user nova-compute[75288]: INFO nova.compute.manager [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Took 6.12 seconds to build instance.
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6d9b4cd6-af77-4d62-8f01-bb59cd28b1a6 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.251s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:08:24 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=24.991943359375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 29b2c407-8c8b-4722-8eec-b1dff1659960 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:08:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:08:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:08:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:08:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:08:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:08:25 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 876c78f2-a975-49ea-9f97-cdca86cc1c51 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updating instance_info_cache with network_info: [{"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:08:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-876c78f2-a975-49ea-9f97-cdca86cc1c51" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:08:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:08:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f is timed out.
Dec 01 14:08:27 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully detached device vdb from instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f from the live domain config.
Dec 01 14:08:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQbiwBCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:08:27 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[520ad699-1c05-4b85-9da6-547b96bec7f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:08:27 user nova-compute[75288]: No targets found.
Dec 01 14:08:27 user nova-compute[75288]: iSNS:
Dec 01 14:08:27 user nova-compute[75288]: No targets found.
Dec 01 14:08:27 user nova-compute[75288]: STATIC:
Dec 01 14:08:27 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e
Dec 01 14:08:27 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:08:27 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:08:27 user nova-compute[75288]: FIRMWARE:
Dec 01 14:08:27 user nova-compute[75288]: No targets found.
Dec 01 14:08:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:08:27 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:08:27 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fc7a1d-0eea-4a6d-8e18-105d5d72c3ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9c55c5-231d-414d-b499-3836e5dc3b37]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e (non-flash)
Dec 01 14:08:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e (non-flash)
Dec 01 14:08:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc31db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2179ca32-bd2f-4181-b717-f1773fa3309c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d07a1-b345-40ee-a99d-23496cdeeb7d]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c43fb53-2321-4b4d-9518-608854f88919]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aeab4c-b5b5-426a-8c7f-457223b2d8e0]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c707e9a-4e96-43e0-9855-7bd900be0120]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6a373e-6b8d-4e26-a713-f9e5e7971321]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e, portal: 172.16.0.220,3260]
Dec 01 14:08:27 user nova-compute[75288]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e, portal: 172.16.0.220,3260] successful.
Dec 01 14:08:27 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16ee07a-c0be-42f9-9885-f068bd27c30e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[424fed91-6356-4f02-8247-2d944fc7fdbb]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] <== disconnect_volume: return (300ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:08:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'flavor' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-17fa7422-0446-498b-81a2-a7384719b406 tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:28 user nova-compute[75288]: INFO nova.compute.manager [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Terminating instance
Dec 01 14:08:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-ee0dd63f-626a-4830-9ddc-637f48accdb0 req-a620570a-2a5e-4440-83f1-feb906890193 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received event network-vif-unplugged-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee0dd63f-626a-4830-9ddc-637f48accdb0 req-a620570a-2a5e-4440-83f1-feb906890193 service nova] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee0dd63f-626a-4830-9ddc-637f48accdb0 req-a620570a-2a5e-4440-83f1-feb906890193 service nova] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee0dd63f-626a-4830-9ddc-637f48accdb0 req-a620570a-2a5e-4440-83f1-feb906890193 service nova] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-ee0dd63f-626a-4830-9ddc-637f48accdb0 req-a620570a-2a5e-4440-83f1-feb906890193 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] No waiting events found dispatching network-vif-unplugged-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-ee0dd63f-626a-4830-9ddc-637f48accdb0 req-a620570a-2a5e-4440-83f1-feb906890193 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received event network-vif-unplugged-aa6649ab-bb65-489c-b81c-53f25e55b510 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Instance destroyed successfully.
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lazy-loading 'resources' on Instance uuid 876c78f2-a975-49ea-9f97-cdca86cc1c51 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T13:47:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1858549183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1858549183',id=17,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T13:48:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e6b677b10d14d63984895b4cfbdad4b',ramdisk_id='',reservation_id='r-zfefft3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-64531845',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T13:49:57Z,user_data=None,user_id='69266afe5e404e259d679d7498f99faa',uuid=876c78f2-a975-49ea-9f97-cdca86cc1c51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converting VIF {"id": "aa6649ab-bb65-489c-b81c-53f25e55b510", "address": "fa:16:3e:8e:ae:c8", "network": {"id": "472a737a-1078-4c27-a78c-d258d608121b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-134811476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e6b677b10d14d63984895b4cfbdad4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6649ab-bb", "ovs_interfaceid": "aa6649ab-bb65-489c-b81c-53f25e55b510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=aa6649ab-bb65-489c-b81c-53f25e55b510,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6649ab-bb') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG os_vif [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=aa6649ab-bb65-489c-b81c-53f25e55b510,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6649ab-bb') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa6649ab-bb, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b2d7900-f6eb-407b-8973-d078e35b09ae) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:29 user nova-compute[75288]: INFO os_vif [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:ae:c8,bridge_name='br-int',has_traffic_filtering=True,id=aa6649ab-bb65-489c-b81c-53f25e55b510,network=Network(472a737a-1078-4c27-a78c-d258d608121b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6649ab-bb')
Dec 01 14:08:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Deleting instance files /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51_del
Dec 01 14:08:29 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Deletion of /opt/stack/data/nova/instances/876c78f2-a975-49ea-9f97-cdca86cc1c51_del complete
Dec 01 14:08:29 user nova-compute[75288]: INFO nova.compute.manager [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Took 1.06 seconds to destroy the instance on the hypervisor.
Dec 01 14:08:29 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:08:29 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:08:30 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:08:30 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Took 0.72 seconds to deallocate network for instance.
Dec 01 14:08:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-6881cb7d-0246-42e3-9cf2-f3a4ad8fe860 req-b9db258c-83f4-4b18-b10c-385144218ec7 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received event network-vif-deleted-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:30 user nova-compute[75288]: INFO nova.compute.manager [req-6881cb7d-0246-42e3-9cf2-f3a4ad8fe860 req-b9db258c-83f4-4b18-b10c-385144218ec7 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Neutron deleted interface aa6649ab-bb65-489c-b81c-53f25e55b510; detaching it from the instance and deleting it from the info cache
Dec 01 14:08:30 user nova-compute[75288]: DEBUG nova.network.neutron [req-6881cb7d-0246-42e3-9cf2-f3a4ad8fe860 req-b9db258c-83f4-4b18-b10c-385144218ec7 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:08:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-6881cb7d-0246-42e3-9cf2-f3a4ad8fe860 req-b9db258c-83f4-4b18-b10c-385144218ec7 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Detach interface failed, port_id=aa6649ab-bb65-489c-b81c-53f25e55b510, reason: Instance 876c78f2-a975-49ea-9f97-cdca86cc1c51 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:08:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:30 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:08:30 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:08:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:30 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Deleted allocations for instance 876c78f2-a975-49ea-9f97-cdca86cc1c51
Dec 01 14:08:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-7a220633-252c-44d5-ae26-1e386bbd55d6 tempest-ServerBootFromVolumeStableRescueTest-64531845 tempest-ServerBootFromVolumeStableRescueTest-64531845-project-member] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b9b573d-16d5-4739-9a99-0b48eda81026 req-b1fc15f4-7fdc-4d49-aa19-6df0bf5c5c34 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received event network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b9b573d-16d5-4739-9a99-0b48eda81026 req-b1fc15f4-7fdc-4d49-aa19-6df0bf5c5c34 service nova] Acquiring lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b9b573d-16d5-4739-9a99-0b48eda81026 req-b1fc15f4-7fdc-4d49-aa19-6df0bf5c5c34 service nova] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b9b573d-16d5-4739-9a99-0b48eda81026 req-b1fc15f4-7fdc-4d49-aa19-6df0bf5c5c34 service nova] Lock "876c78f2-a975-49ea-9f97-cdca86cc1c51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:31 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b9b573d-16d5-4739-9a99-0b48eda81026 req-b1fc15f4-7fdc-4d49-aa19-6df0bf5c5c34 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] No waiting events found dispatching network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:08:31 user nova-compute[75288]: WARNING nova.compute.manager [req-3b9b573d-16d5-4739-9a99-0b48eda81026 req-b1fc15f4-7fdc-4d49-aa19-6df0bf5c5c34 service nova] [instance: 876c78f2-a975-49ea-9f97-cdca86cc1c51] Received unexpected event network-vif-plugged-aa6649ab-bb65-489c-b81c-53f25e55b510 for instance with vm_state deleted and task_state None.
Dec 01 14:08:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:08:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:08:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:08:37 user nova-compute[75288]: INFO nova.compute.claims [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Claim successful on node user
Dec 01 14:08:37 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:08:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:08:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:08:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG nova.policy [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02f74cb0fb13418b894e8517317bea9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fae7777bb784a55b159c88bc38e4fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:08:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Creating image(s)
Dec 01 14:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "/opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "/opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "fda2c37c3ae9209732d533344b2a8a09f10742e9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "fda2c37c3ae9209732d533344b2a8a09f10742e9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Successfully created port: c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG nova.virt.images [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] 72279a56-d0d4-45ec-81b3-58c4f3232bbb was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 14:08:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9.part /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9.part /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9.converted" returned: 0 in 0.484s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "fda2c37c3ae9209732d533344b2a8a09f10742e9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.478s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Successfully updated port: c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquired lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-aebf8d66-b685-40af-b4cb-56c8e628a266 req-178613a2-18da-4920-a210-3787a4ba8343 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-aebf8d66-b685-40af-b4cb-56c8e628a266 req-178613a2-18da-4920-a210-3787a4ba8343 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing instance network info cache due to event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aebf8d66-b685-40af-b4cb-56c8e628a266 req-178613a2-18da-4920-a210-3787a4ba8343 service nova] Acquiring lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "fda2c37c3ae9209732d533344b2a8a09f10742e9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "fda2c37c3ae9209732d533344b2a8a09f10742e9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 --force-share --output=json" returned: 0 in 0.166s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9,backing_fmt=raw /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9,backing_fmt=raw /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk 1073741824" returned: 0 in 0.048s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "fda2c37c3ae9209732d533344b2a8a09f10742e9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Cannot resize image /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Ensure instance console log exists: /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Releasing lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Instance network_info: |[{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aebf8d66-b685-40af-b4cb-56c8e628a266 req-178613a2-18da-4920-a210-3787a4ba8343 service nova] Acquired lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-aebf8d66-b685-40af-b4cb-56c8e628a266 req-178613a2-18da-4920-a210-3787a4ba8343 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Start _get_guest_xml network_info=[{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T14:08:35Z,direct_url=<?>,disk_format='qcow2',id=72279a56-d0d4-45ec-81b3-58c4f3232bbb,min_disk=0,min_ram=0,name='tempest-scenario-img--1283543641',owner='5fae7777bb784a55b159c88bc38e4fe9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T14:08:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '72279a56-d0d4-45ec-81b3-58c4f3232bbb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:08:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:08:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T14:08:35Z,direct_url=<?>,disk_format='qcow2',id=72279a56-d0d4-45ec-81b3-58c4f3232bbb,min_disk=0,min_ram=0,name='tempest-scenario-img--1283543641',owner='5fae7777bb784a55b159c88bc38e4fe9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T14:08:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2033342625',display_name='tempest-TestMinimumBasicScenario-server-2033342625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2033342625',id=43,image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZR3GgEecmQd7suZ3Kuut7N5ZxRLtI7Epo/GolBsiosWZo+Z9jbNd/c2h/duv0WBExWj89HIOK1LbzjT6wNgKTBFwea/O7UnGbNmUIJNTXGMImJwVi6pE35H9+2eZMu9w==',key_name='tempest-TestMinimumBasicScenario-1390302078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ewu3008a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:08:38Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=8a12810b-951d-49dd-b806-7f8f5450b0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:08:40 user nova-compute[75288]:   <uuid>8a12810b-951d-49dd-b806-7f8f5450b0b5</uuid>
Dec 01 14:08:40 user nova-compute[75288]:   <name>instance-0000002b</name>
Dec 01 14:08:40 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:08:40 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:08:40 user nova-compute[75288]:   <metadata>
Dec 01 14:08:40 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:08:40 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:08:40 user nova-compute[75288]:       <nova:name>tempest-TestMinimumBasicScenario-server-2033342625</nova:name>
Dec 01 14:08:40 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:08:40</nova:creationTime>
Dec 01 14:08:40 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:08:40 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:08:40 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:08:40 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:08:40 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:08:40 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:08:40 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:08:40 user nova-compute[75288]:       <nova:owner>
Dec 01 14:08:40 user nova-compute[75288]:         <nova:user uuid="02f74cb0fb13418b894e8517317bea9e">tempest-TestMinimumBasicScenario-652077982-project-member</nova:user>
Dec 01 14:08:40 user nova-compute[75288]:         <nova:project uuid="5fae7777bb784a55b159c88bc38e4fe9">tempest-TestMinimumBasicScenario-652077982</nova:project>
Dec 01 14:08:40 user nova-compute[75288]:       </nova:owner>
Dec 01 14:08:40 user nova-compute[75288]:       <nova:root type="image" uuid="72279a56-d0d4-45ec-81b3-58c4f3232bbb"/>
Dec 01 14:08:40 user nova-compute[75288]:       <nova:ports>
Dec 01 14:08:40 user nova-compute[75288]:         <nova:port uuid="c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa">
Dec 01 14:08:40 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 14:08:40 user nova-compute[75288]:         </nova:port>
Dec 01 14:08:40 user nova-compute[75288]:       </nova:ports>
Dec 01 14:08:40 user nova-compute[75288]:     </nova:instance>
Dec 01 14:08:40 user nova-compute[75288]:   </metadata>
Dec 01 14:08:40 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:08:40 user nova-compute[75288]:     <system>
Dec 01 14:08:40 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:08:40 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:08:40 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:08:40 user nova-compute[75288]:       <entry name="serial">8a12810b-951d-49dd-b806-7f8f5450b0b5</entry>
Dec 01 14:08:40 user nova-compute[75288]:       <entry name="uuid">8a12810b-951d-49dd-b806-7f8f5450b0b5</entry>
Dec 01 14:08:40 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:08:40 user nova-compute[75288]:     </system>
Dec 01 14:08:40 user nova-compute[75288]:   </sysinfo>
Dec 01 14:08:40 user nova-compute[75288]:   <os>
Dec 01 14:08:40 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:08:40 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:08:40 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:08:40 user nova-compute[75288]:   </os>
Dec 01 14:08:40 user nova-compute[75288]:   <features>
Dec 01 14:08:40 user nova-compute[75288]:     <acpi/>
Dec 01 14:08:40 user nova-compute[75288]:     <apic/>
Dec 01 14:08:40 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:08:40 user nova-compute[75288]:   </features>
Dec 01 14:08:40 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:08:40 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:08:40 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:08:40 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:08:40 user nova-compute[75288]:   </clock>
Dec 01 14:08:40 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:08:40 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:08:40 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:08:40 user nova-compute[75288]:   </cpu>
Dec 01 14:08:40 user nova-compute[75288]:   <devices>
Dec 01 14:08:40 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:08:40 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:08:40 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk"/>
Dec 01 14:08:40 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:08:40 user nova-compute[75288]:     </disk>
Dec 01 14:08:40 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:08:40 user nova-compute[75288]:       <mac address="fa:16:3e:a7:02:3e"/>
Dec 01 14:08:40 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:08:40 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:08:40 user nova-compute[75288]:       <target dev="tapc5ca0ba9-dc"/>
Dec 01 14:08:40 user nova-compute[75288]:     </interface>
Dec 01 14:08:40 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:08:40 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/console.log" append="off"/>
Dec 01 14:08:40 user nova-compute[75288]:     </serial>
Dec 01 14:08:40 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:08:40 user nova-compute[75288]:     <video>
Dec 01 14:08:40 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:08:40 user nova-compute[75288]:     </video>
Dec 01 14:08:40 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:08:40 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:08:40 user nova-compute[75288]:     </rng>
Dec 01 14:08:40 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:08:40 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:08:40 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:08:40 user nova-compute[75288]:     </memballoon>
Dec 01 14:08:40 user nova-compute[75288]:   </devices>
Dec 01 14:08:40 user nova-compute[75288]: </domain>
Dec 01 14:08:40 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2033342625',display_name='tempest-TestMinimumBasicScenario-server-2033342625',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2033342625',id=43,image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZR3GgEecmQd7suZ3Kuut7N5ZxRLtI7Epo/GolBsiosWZo+Z9jbNd/c2h/duv0WBExWj89HIOK1LbzjT6wNgKTBFwea/O7UnGbNmUIJNTXGMImJwVi6pE35H9+2eZMu9w==',key_name='tempest-TestMinimumBasicScenario-1390302078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ewu3008a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:08:38Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=8a12810b-951d-49dd-b806-7f8f5450b0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG os_vif [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18b9b958-138e-53ff-ba81-1cbf7780aa17', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5ca0ba9-dc, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5ca0ba9-dc, col_values=(('qos', UUID('ab4c8d49-a374-48a5-8f01-9c9c0030d706')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5ca0ba9-dc, col_values=(('external_ids', {'iface-id': 'c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:02:3e', 'vm-uuid': '8a12810b-951d-49dd-b806-7f8f5450b0b5'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:40 user nova-compute[75288]: INFO os_vif [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc')
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No VIF found with MAC fa:16:3e:a7:02:3e, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-aebf8d66-b685-40af-b4cb-56c8e628a266 req-178613a2-18da-4920-a210-3787a4ba8343 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updated VIF entry in instance network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-aebf8d66-b685-40af-b4cb-56c8e628a266 req-178613a2-18da-4920-a210-3787a4ba8343 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:08:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-aebf8d66-b685-40af-b4cb-56c8e628a266 req-178613a2-18da-4920-a210-3787a4ba8343 service nova] Releasing lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:08:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-583e9697-e62a-415b-8c84-3a786626949c req-eb339f97-98f5-4ab1-a952-f6426a891c30 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-583e9697-e62a-415b-8c84-3a786626949c req-eb339f97-98f5-4ab1-a952-f6426a891c30 service nova] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-583e9697-e62a-415b-8c84-3a786626949c req-eb339f97-98f5-4ab1-a952-f6426a891c30 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-583e9697-e62a-415b-8c84-3a786626949c req-eb339f97-98f5-4ab1-a952-f6426a891c30 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-583e9697-e62a-415b-8c84-3a786626949c req-eb339f97-98f5-4ab1-a952-f6426a891c30 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] No waiting events found dispatching network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:08:42 user nova-compute[75288]: WARNING nova.compute.manager [req-583e9697-e62a-415b-8c84-3a786626949c req-eb339f97-98f5-4ab1-a952-f6426a891c30 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received unexpected event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa for instance with vm_state building and task_state spawning.
Dec 01 14:08:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:08:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:08:43 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Instance spawned successfully.
Dec 01 14:08:43 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:08:44 user nova-compute[75288]: INFO nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Took 6.01 seconds to spawn the instance on the hypervisor.
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-2b2fdd1e-cb1d-4337-ac00-1d0785010e11 req-fcff9f2a-b901-4568-a204-9dfd42e683e1 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b2fdd1e-cb1d-4337-ac00-1d0785010e11 req-fcff9f2a-b901-4568-a204-9dfd42e683e1 service nova] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b2fdd1e-cb1d-4337-ac00-1d0785010e11 req-fcff9f2a-b901-4568-a204-9dfd42e683e1 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2b2fdd1e-cb1d-4337-ac00-1d0785010e11 req-fcff9f2a-b901-4568-a204-9dfd42e683e1 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-2b2fdd1e-cb1d-4337-ac00-1d0785010e11 req-fcff9f2a-b901-4568-a204-9dfd42e683e1 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] No waiting events found dispatching network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:08:44 user nova-compute[75288]: WARNING nova.compute.manager [req-2b2fdd1e-cb1d-4337-ac00-1d0785010e11 req-fcff9f2a-b901-4568-a204-9dfd42e683e1 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received unexpected event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa for instance with vm_state building and task_state spawning.
Dec 01 14:08:44 user nova-compute[75288]: INFO nova.compute.manager [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Took 6.72 seconds to build instance.
Dec 01 14:08:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9183df92-45a5-4167-a8a6-7af33b8f238a tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.813s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquired lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'info_cache' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Releasing lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:08:47 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance destroyed successfully.
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'resources' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG os_vif [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef8189f5-33, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4dad1dc-b05d-45a6-b291-240828c6f88f) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:47 user nova-compute[75288]: INFO os_vif [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33')
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Start _get_guest_xml network_info=[{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'numa_topology' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:08:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:08:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'pci_devices' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.objects.base [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:08:47 user nova-compute[75288]:   <uuid>ba42382c-6649-4dd3-8ef6-aee0f151fda3</uuid>
Dec 01 14:08:47 user nova-compute[75288]:   <name>instance-00000026</name>
Dec 01 14:08:47 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:08:47 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:08:47 user nova-compute[75288]:   <metadata>
Dec 01 14:08:47 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:08:47 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:08:47 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeTestJSON-server-1282332462</nova:name>
Dec 01 14:08:47 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:08:47</nova:creationTime>
Dec 01 14:08:47 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:08:47 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:08:47 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:08:47 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:08:47 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:08:47 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:08:47 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:08:47 user nova-compute[75288]:       <nova:owner>
Dec 01 14:08:47 user nova-compute[75288]:         <nova:user uuid="9ce70853828047c2a95d82b34f79cc96">tempest-AttachVolumeTestJSON-800128847-project-member</nova:user>
Dec 01 14:08:47 user nova-compute[75288]:         <nova:project uuid="1d43be7c75dc4274801b9860ded7693d">tempest-AttachVolumeTestJSON-800128847</nova:project>
Dec 01 14:08:47 user nova-compute[75288]:       </nova:owner>
Dec 01 14:08:47 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:08:47 user nova-compute[75288]:       <nova:ports>
Dec 01 14:08:47 user nova-compute[75288]:         <nova:port uuid="ef8189f5-33cb-4afa-9d8b-2890e86c9e28">
Dec 01 14:08:47 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 14:08:47 user nova-compute[75288]:         </nova:port>
Dec 01 14:08:47 user nova-compute[75288]:       </nova:ports>
Dec 01 14:08:47 user nova-compute[75288]:     </nova:instance>
Dec 01 14:08:47 user nova-compute[75288]:   </metadata>
Dec 01 14:08:47 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:08:47 user nova-compute[75288]:     <system>
Dec 01 14:08:47 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:08:47 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:08:47 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:08:47 user nova-compute[75288]:       <entry name="serial">ba42382c-6649-4dd3-8ef6-aee0f151fda3</entry>
Dec 01 14:08:47 user nova-compute[75288]:       <entry name="uuid">ba42382c-6649-4dd3-8ef6-aee0f151fda3</entry>
Dec 01 14:08:47 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:08:47 user nova-compute[75288]:     </system>
Dec 01 14:08:47 user nova-compute[75288]:   </sysinfo>
Dec 01 14:08:47 user nova-compute[75288]:   <os>
Dec 01 14:08:47 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:08:47 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:08:47 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:08:47 user nova-compute[75288]:   </os>
Dec 01 14:08:47 user nova-compute[75288]:   <features>
Dec 01 14:08:47 user nova-compute[75288]:     <acpi/>
Dec 01 14:08:47 user nova-compute[75288]:     <apic/>
Dec 01 14:08:47 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:08:47 user nova-compute[75288]:   </features>
Dec 01 14:08:47 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:08:47 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:08:47 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:08:47 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:08:47 user nova-compute[75288]:   </clock>
Dec 01 14:08:47 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:08:47 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:08:47 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:08:47 user nova-compute[75288]:   </cpu>
Dec 01 14:08:47 user nova-compute[75288]:   <devices>
Dec 01 14:08:47 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:08:47 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:08:47 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk"/>
Dec 01 14:08:47 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:08:47 user nova-compute[75288]:     </disk>
Dec 01 14:08:47 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:08:47 user nova-compute[75288]:       <mac address="fa:16:3e:18:bf:e4"/>
Dec 01 14:08:47 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:08:47 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:08:47 user nova-compute[75288]:       <target dev="tapef8189f5-33"/>
Dec 01 14:08:47 user nova-compute[75288]:     </interface>
Dec 01 14:08:47 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:08:47 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/console.log" append="off"/>
Dec 01 14:08:47 user nova-compute[75288]:     </serial>
Dec 01 14:08:47 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:08:47 user nova-compute[75288]:     <video>
Dec 01 14:08:47 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:08:47 user nova-compute[75288]:     </video>
Dec 01 14:08:47 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:08:47 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:08:47 user nova-compute[75288]:     </rng>
Dec 01 14:08:47 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:08:47 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:08:47 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:08:47 user nova-compute[75288]:     </memballoon>
Dec 01 14:08:47 user nova-compute[75288]:   </devices>
Dec 01 14:08:47 user nova-compute[75288]: </domain>
Dec 01 14:08:47 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.objects.base [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Cannot resize image /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'migration_context' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.objects.base [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Object Instance<ba42382c-6649-4dd3-8ef6-aee0f151fda3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG os_vif [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fdf3614-d2b0-5080-bf87-e397cd38d26d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef8189f5-33, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef8189f5-33, col_values=(('qos', UUID('c7951746-f90d-48a2-b4ae-5bd70667c821')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef8189f5-33, col_values=(('external_ids', {'iface-id': 'ef8189f5-33cb-4afa-9d8b-2890e86c9e28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:bf:e4', 'vm-uuid': 'ba42382c-6649-4dd3-8ef6-aee0f151fda3'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:08:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:48 user nova-compute[75288]: INFO os_vif [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33')
Dec 01 14:08:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-df74e13e-9368-47e6-98df-bc40e4a1d5ec req-7de5488f-4fee-4690-858e-1ca78b70548f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-df74e13e-9368-47e6-98df-bc40e4a1d5ec req-7de5488f-4fee-4690-858e-1ca78b70548f service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-df74e13e-9368-47e6-98df-bc40e4a1d5ec req-7de5488f-4fee-4690-858e-1ca78b70548f service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-df74e13e-9368-47e6-98df-bc40e4a1d5ec req-7de5488f-4fee-4690-858e-1ca78b70548f service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-df74e13e-9368-47e6-98df-bc40e4a1d5ec req-7de5488f-4fee-4690-858e-1ca78b70548f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:08:50 user nova-compute[75288]: WARNING nova.compute.manager [req-df74e13e-9368-47e6-98df-bc40e4a1d5ec req-7de5488f-4fee-4690-858e-1ca78b70548f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state stopped and task_state powering-on.
Dec 01 14:08:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:08:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance rebooted successfully.
Dec 01 14:08:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-4c6daf1b-5eeb-45db-910b-a869e73e70bd tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:08:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b4505b1-783e-41d1-88ce-a724a1f4a390 req-4284179d-31df-478e-8fef-645cb83fa664 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:08:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b4505b1-783e-41d1-88ce-a724a1f4a390 req-4284179d-31df-478e-8fef-645cb83fa664 service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:08:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b4505b1-783e-41d1-88ce-a724a1f4a390 req-4284179d-31df-478e-8fef-645cb83fa664 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:08:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b4505b1-783e-41d1-88ce-a724a1f4a390 req-4284179d-31df-478e-8fef-645cb83fa664 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:08:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b4505b1-783e-41d1-88ce-a724a1f4a390 req-4284179d-31df-478e-8fef-645cb83fa664 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:08:52 user nova-compute[75288]: WARNING nova.compute.manager [req-6b4505b1-783e-41d1-88ce-a724a1f4a390 req-4284179d-31df-478e-8fef-645cb83fa664 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state active and task_state None.
Dec 01 14:08:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:08:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:20 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [{"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-ba42382c-6649-4dd3-8ef6-aee0f151fda3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:09:23 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:09:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:09:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:09:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:09:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:09:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:09:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:09:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:09:25 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:09:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8453MB free_disk=24.980987548828125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:09:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:09:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 29b2c407-8c8b-4722-8eec-b1dff1659960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:09:27 user nova-compute[75288]: INFO nova.compute.manager [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Terminating instance
Dec 01 14:09:27 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-261403a2-af7d-4e9d-adcb-eb47a91cdee1 req-c5f2d616-7669-4dfc-a6c7-b9b815fb966e service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received event network-vif-unplugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-261403a2-af7d-4e9d-adcb-eb47a91cdee1 req-c5f2d616-7669-4dfc-a6c7-b9b815fb966e service nova] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-261403a2-af7d-4e9d-adcb-eb47a91cdee1 req-c5f2d616-7669-4dfc-a6c7-b9b815fb966e service nova] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-261403a2-af7d-4e9d-adcb-eb47a91cdee1 req-c5f2d616-7669-4dfc-a6c7-b9b815fb966e service nova] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-261403a2-af7d-4e9d-adcb-eb47a91cdee1 req-c5f2d616-7669-4dfc-a6c7-b9b815fb966e service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] No waiting events found dispatching network-vif-unplugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG nova.compute.manager [req-261403a2-af7d-4e9d-adcb-eb47a91cdee1 req-c5f2d616-7669-4dfc-a6c7-b9b815fb966e service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received event network-vif-unplugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Instance destroyed successfully.
Dec 01 14:09:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lazy-loading 'resources' on Instance uuid e3e8acdb-747c-4b23-9a8b-70d7f0ce510f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1400986693',display_name='tempest-SnapshotDataIntegrityTests-server-1400986693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1400986693',id=40,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNOPsVZUL7DraoVItxPks7RoTxCqYPfCfiSWFhVOmp3JHqwlqOHq1yzgWib3Gs0X0eXWdnMdRtPmcr8hqNeVxHHdOqSfP6RnviIsDFhrx4amGmISFYSVG9p+L4OjZaU8g==',key_name='tempest-keypair-1943678575',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:02:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='665e8f7b1e514cd182ce6e1977e4a89a',ramdisk_id='',reservation_id='r-lse902ok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1546553843',owner_user_name='tempest-SnapshotDataIntegrityTests-1546553843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:02:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca29852ee4b449c588d19457634538e1',uuid=e3e8acdb-747c-4b23-9a8b-70d7f0ce510f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Converting VIF {"id": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "address": "fa:16:3e:7c:b8:ac", "network": {"id": "79d7c8e1-73ef-462f-b122-fa53f1d4055b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645932334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "665e8f7b1e514cd182ce6e1977e4a89a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d0feb4-7c", "ovs_interfaceid": "32d0feb4-7ca9-4529-a5fd-db95327b1bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=32d0feb4-7ca9-4529-a5fd-db95327b1bb0,network=Network(79d7c8e1-73ef-462f-b122-fa53f1d4055b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d0feb4-7c') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG os_vif [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=32d0feb4-7ca9-4529-a5fd-db95327b1bb0,network=Network(79d7c8e1-73ef-462f-b122-fa53f1d4055b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d0feb4-7c') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32d0feb4-7c, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=088c5de0-fb14-4f8a-b1bf-41375ec67a92) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:09:28 user nova-compute[75288]: INFO os_vif [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:b8:ac,bridge_name='br-int',has_traffic_filtering=True,id=32d0feb4-7ca9-4529-a5fd-db95327b1bb0,network=Network(79d7c8e1-73ef-462f-b122-fa53f1d4055b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d0feb4-7c')
Dec 01 14:09:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Deleting instance files /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f_del
Dec 01 14:09:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Deletion of /opt/stack/data/nova/instances/e3e8acdb-747c-4b23-9a8b-70d7f0ce510f_del complete
Dec 01 14:09:28 user nova-compute[75288]: INFO nova.compute.manager [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 01 14:09:28 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:28 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:09:28 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Took 0.72 seconds to deallocate network for instance.
Dec 01 14:09:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-bf5e7e19-4ce2-4606-96e7-408dbc064267 req-1d48cd44-ab42-410f-9a37-8c846f3500c2 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received event network-vif-deleted-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:09:29 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Deleted allocations for instance e3e8acdb-747c-4b23-9a8b-70d7f0ce510f
Dec 01 14:09:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f1866b52-dbe2-4fd8-87c4-14d582b3710b tempest-SnapshotDataIntegrityTests-1546553843 tempest-SnapshotDataIntegrityTests-1546553843-project-member] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-9d495f48-85df-46b6-80f9-dafc3a2f9d17 req-72474372-4027-499f-8aa9-627202ae7e46 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received event network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9d495f48-85df-46b6-80f9-dafc3a2f9d17 req-72474372-4027-499f-8aa9-627202ae7e46 service nova] Acquiring lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9d495f48-85df-46b6-80f9-dafc3a2f9d17 req-72474372-4027-499f-8aa9-627202ae7e46 service nova] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9d495f48-85df-46b6-80f9-dafc3a2f9d17 req-72474372-4027-499f-8aa9-627202ae7e46 service nova] Lock "e3e8acdb-747c-4b23-9a8b-70d7f0ce510f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:09:29 user nova-compute[75288]: DEBUG nova.compute.manager [req-9d495f48-85df-46b6-80f9-dafc3a2f9d17 req-72474372-4027-499f-8aa9-627202ae7e46 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] No waiting events found dispatching network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:09:29 user nova-compute[75288]: WARNING nova.compute.manager [req-9d495f48-85df-46b6-80f9-dafc3a2f9d17 req-72474372-4027-499f-8aa9-627202ae7e46 service nova] [instance: e3e8acdb-747c-4b23-9a8b-70d7f0ce510f] Received unexpected event network-vif-plugged-32d0feb4-7ca9-4529-a5fd-db95327b1bb0 for instance with vm_state deleted and task_state None.
Dec 01 14:09:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:09:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:09:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:09:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:09:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:55 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:09:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 14:09:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 14:09:55 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance has had 5 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Dec 01 14:09:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:09:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:10:04 user nova-compute[75288]: INFO nova.compute.claims [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Claim successful on node user
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Refreshing inventories for resource provider 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Updating ProviderTree inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Refreshing aggregate associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Refreshing trait associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.network.neutron [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:10:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.policy [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0c1c4feb6d448ffa4032d725206e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c81faa0ffc4f8881312e037ca7ac3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:10:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Creating image(s)
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "/opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "/opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:04 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.202s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk 1073741824" returned: 0 in 0.057s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Successfully created port: a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Cannot resize image /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Ensure instance console log exists: /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Successfully updated port: a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "refresh_cache-3bc5123a-6d10-445d-90ca-7cb920e0a729" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquired lock "refresh_cache-3bc5123a-6d10-445d-90ca-7cb920e0a729" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.network.neutron [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-66749d9b-8433-425c-9f08-3d019c2e17aa req-4d267a04-eca8-405b-ab5b-ef580a701507 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received event network-changed-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG nova.compute.manager [req-66749d9b-8433-425c-9f08-3d019c2e17aa req-4d267a04-eca8-405b-ab5b-ef580a701507 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Refreshing instance network info cache due to event network-changed-a195854e-04a0-4548-8cee-35945bbd80c3. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:10:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66749d9b-8433-425c-9f08-3d019c2e17aa req-4d267a04-eca8-405b-ab5b-ef580a701507 service nova] Acquiring lock "refresh_cache-3bc5123a-6d10-445d-90ca-7cb920e0a729" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.network.neutron [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Updating instance_info_cache with network_info: [{"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Releasing lock "refresh_cache-3bc5123a-6d10-445d-90ca-7cb920e0a729" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Instance network_info: |[{"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66749d9b-8433-425c-9f08-3d019c2e17aa req-4d267a04-eca8-405b-ab5b-ef580a701507 service nova] Acquired lock "refresh_cache-3bc5123a-6d10-445d-90ca-7cb920e0a729" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-66749d9b-8433-425c-9f08-3d019c2e17aa req-4d267a04-eca8-405b-ab5b-ef580a701507 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Refreshing network info cache for port a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Start _get_guest_xml network_info=[{"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:10:06 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:10:06 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1037537926',display_name='tempest-VolumesActionsTest-instance-1037537926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1037537926',id=44,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c81faa0ffc4f8881312e037ca7ac3a',ramdisk_id='',reservation_id='r-z5e89nle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1772844408',owner_user_name='tempest-VolumesActionsTest-1772844408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:10:05Z,user_data=None,user_id='e0c1c4feb6d448ffa4032d725206e293',uuid=3bc5123a-6d10-445d-90ca-7cb920e0a729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converting VIF {"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:63:a4,bridge_name='br-int',has_traffic_filtering=True,id=a195854e-04a0-4548-8cee-35945bbd80c3,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa195854e-04') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.objects.instance [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bc5123a-6d10-445d-90ca-7cb920e0a729 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:10:06 user nova-compute[75288]:   <uuid>3bc5123a-6d10-445d-90ca-7cb920e0a729</uuid>
Dec 01 14:10:06 user nova-compute[75288]:   <name>instance-0000002c</name>
Dec 01 14:10:06 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:10:06 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:10:06 user nova-compute[75288]:   <metadata>
Dec 01 14:10:06 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:10:06 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:10:06 user nova-compute[75288]:       <nova:name>tempest-VolumesActionsTest-instance-1037537926</nova:name>
Dec 01 14:10:06 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:10:06</nova:creationTime>
Dec 01 14:10:06 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:10:06 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:10:06 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:10:06 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:10:06 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:10:06 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:10:06 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:10:06 user nova-compute[75288]:       <nova:owner>
Dec 01 14:10:06 user nova-compute[75288]:         <nova:user uuid="e0c1c4feb6d448ffa4032d725206e293">tempest-VolumesActionsTest-1772844408-project-member</nova:user>
Dec 01 14:10:06 user nova-compute[75288]:         <nova:project uuid="77c81faa0ffc4f8881312e037ca7ac3a">tempest-VolumesActionsTest-1772844408</nova:project>
Dec 01 14:10:06 user nova-compute[75288]:       </nova:owner>
Dec 01 14:10:06 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:10:06 user nova-compute[75288]:       <nova:ports>
Dec 01 14:10:06 user nova-compute[75288]:         <nova:port uuid="a195854e-04a0-4548-8cee-35945bbd80c3">
Dec 01 14:10:06 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 14:10:06 user nova-compute[75288]:         </nova:port>
Dec 01 14:10:06 user nova-compute[75288]:       </nova:ports>
Dec 01 14:10:06 user nova-compute[75288]:     </nova:instance>
Dec 01 14:10:06 user nova-compute[75288]:   </metadata>
Dec 01 14:10:06 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:10:06 user nova-compute[75288]:     <system>
Dec 01 14:10:06 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:10:06 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:10:06 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:10:06 user nova-compute[75288]:       <entry name="serial">3bc5123a-6d10-445d-90ca-7cb920e0a729</entry>
Dec 01 14:10:06 user nova-compute[75288]:       <entry name="uuid">3bc5123a-6d10-445d-90ca-7cb920e0a729</entry>
Dec 01 14:10:06 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:10:06 user nova-compute[75288]:     </system>
Dec 01 14:10:06 user nova-compute[75288]:   </sysinfo>
Dec 01 14:10:06 user nova-compute[75288]:   <os>
Dec 01 14:10:06 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:10:06 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:10:06 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:10:06 user nova-compute[75288]:   </os>
Dec 01 14:10:06 user nova-compute[75288]:   <features>
Dec 01 14:10:06 user nova-compute[75288]:     <acpi/>
Dec 01 14:10:06 user nova-compute[75288]:     <apic/>
Dec 01 14:10:06 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:10:06 user nova-compute[75288]:   </features>
Dec 01 14:10:06 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:10:06 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:10:06 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:10:06 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:10:06 user nova-compute[75288]:   </clock>
Dec 01 14:10:06 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:10:06 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:10:06 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:10:06 user nova-compute[75288]:   </cpu>
Dec 01 14:10:06 user nova-compute[75288]:   <devices>
Dec 01 14:10:06 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:10:06 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:10:06 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk"/>
Dec 01 14:10:06 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:10:06 user nova-compute[75288]:     </disk>
Dec 01 14:10:06 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:10:06 user nova-compute[75288]:       <mac address="fa:16:3e:f3:63:a4"/>
Dec 01 14:10:06 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:10:06 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:10:06 user nova-compute[75288]:       <target dev="tapa195854e-04"/>
Dec 01 14:10:06 user nova-compute[75288]:     </interface>
Dec 01 14:10:06 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:10:06 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/console.log" append="off"/>
Dec 01 14:10:06 user nova-compute[75288]:     </serial>
Dec 01 14:10:06 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:10:06 user nova-compute[75288]:     <video>
Dec 01 14:10:06 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:10:06 user nova-compute[75288]:     </video>
Dec 01 14:10:06 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:10:06 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:10:06 user nova-compute[75288]:     </rng>
Dec 01 14:10:06 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:10:06 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:10:06 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:10:06 user nova-compute[75288]:     </memballoon>
Dec 01 14:10:06 user nova-compute[75288]:   </devices>
Dec 01 14:10:06 user nova-compute[75288]: </domain>
Dec 01 14:10:06 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1037537926',display_name='tempest-VolumesActionsTest-instance-1037537926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1037537926',id=44,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c81faa0ffc4f8881312e037ca7ac3a',ramdisk_id='',reservation_id='r-z5e89nle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1772844408',owner_user_name='tempest-VolumesActionsTest-1772844408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:10:05Z,user_data=None,user_id='e0c1c4feb6d448ffa4032d725206e293',uuid=3bc5123a-6d10-445d-90ca-7cb920e0a729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converting VIF {"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:63:a4,bridge_name='br-int',has_traffic_filtering=True,id=a195854e-04a0-4548-8cee-35945bbd80c3,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa195854e-04') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG os_vif [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:63:a4,bridge_name='br-int',has_traffic_filtering=True,id=a195854e-04a0-4548-8cee-35945bbd80c3,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa195854e-04') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6a3c1bd-5233-5e62-b91f-4d6b0e0b362d', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa195854e-04, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa195854e-04, col_values=(('qos', UUID('544c53da-ab54-4c6f-b456-06553433c0f2')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa195854e-04, col_values=(('external_ids', {'iface-id': 'a195854e-04a0-4548-8cee-35945bbd80c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:63:a4', 'vm-uuid': '3bc5123a-6d10-445d-90ca-7cb920e0a729'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:06 user nova-compute[75288]: INFO os_vif [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:63:a4,bridge_name='br-int',has_traffic_filtering=True,id=a195854e-04a0-4548-8cee-35945bbd80c3,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa195854e-04')
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] No VIF found with MAC fa:16:3e:f3:63:a4, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-66749d9b-8433-425c-9f08-3d019c2e17aa req-4d267a04-eca8-405b-ab5b-ef580a701507 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Updated VIF entry in instance network info cache for port a195854e-04a0-4548-8cee-35945bbd80c3. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG nova.network.neutron [req-66749d9b-8433-425c-9f08-3d019c2e17aa req-4d267a04-eca8-405b-ab5b-ef580a701507 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Updating instance_info_cache with network_info: [{"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66749d9b-8433-425c-9f08-3d019c2e17aa req-4d267a04-eca8-405b-ab5b-ef580a701507 service nova] Releasing lock "refresh_cache-3bc5123a-6d10-445d-90ca-7cb920e0a729" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-f14dbc75-1507-4b43-aa62-258ceedabbe6 req-d98a933c-8ecd-4aff-aa13-7e4d6705f0b6 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received event network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f14dbc75-1507-4b43-aa62-258ceedabbe6 req-d98a933c-8ecd-4aff-aa13-7e4d6705f0b6 service nova] Acquiring lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f14dbc75-1507-4b43-aa62-258ceedabbe6 req-d98a933c-8ecd-4aff-aa13-7e4d6705f0b6 service nova] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:07 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f14dbc75-1507-4b43-aa62-258ceedabbe6 req-d98a933c-8ecd-4aff-aa13-7e4d6705f0b6 service nova] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:07 user nova-compute[75288]: DEBUG nova.compute.manager [req-f14dbc75-1507-4b43-aa62-258ceedabbe6 req-d98a933c-8ecd-4aff-aa13-7e4d6705f0b6 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] No waiting events found dispatching network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:10:07 user nova-compute[75288]: WARNING nova.compute.manager [req-f14dbc75-1507-4b43-aa62-258ceedabbe6 req-d98a933c-8ecd-4aff-aa13-7e4d6705f0b6 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received unexpected event network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 for instance with vm_state building and task_state spawning.
Dec 01 14:10:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-0dd18465-f7b7-4a7b-b686-8d7a2a66c82e req-1007216c-c4ef-41b1-94ee-80f47ffa0964 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received event network-changed-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG nova.compute.manager [req-0dd18465-f7b7-4a7b-b686-8d7a2a66c82e req-1007216c-c4ef-41b1-94ee-80f47ffa0964 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Refreshing instance network info cache due to event network-changed-cd6e5ca0-8656-4f7d-8679-931e3418984a. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0dd18465-f7b7-4a7b-b686-8d7a2a66c82e req-1007216c-c4ef-41b1-94ee-80f47ffa0964 service nova] Acquiring lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0dd18465-f7b7-4a7b-b686-8d7a2a66c82e req-1007216c-c4ef-41b1-94ee-80f47ffa0964 service nova] Acquired lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-0dd18465-f7b7-4a7b-b686-8d7a2a66c82e req-1007216c-c4ef-41b1-94ee-80f47ffa0964 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Refreshing network info cache for port cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-0dd18465-f7b7-4a7b-b686-8d7a2a66c82e req-1007216c-c4ef-41b1-94ee-80f47ffa0964 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updated VIF entry in instance network info cache for port cd6e5ca0-8656-4f7d-8679-931e3418984a. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG nova.network.neutron [req-0dd18465-f7b7-4a7b-b686-8d7a2a66c82e req-1007216c-c4ef-41b1-94ee-80f47ffa0964 service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updating instance_info_cache with network_info: [{"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-0dd18465-f7b7-4a7b-b686-8d7a2a66c82e req-1007216c-c4ef-41b1-94ee-80f47ffa0964 service nova] Releasing lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:10:09 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Instance spawned successfully.
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a9cdace-80a0-4e9b-bfd6-c0c3eaa173fa req-f0c0a6e5-8c2f-46a8-812a-63cfbb51f61e service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received event network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a9cdace-80a0-4e9b-bfd6-c0c3eaa173fa req-f0c0a6e5-8c2f-46a8-812a-63cfbb51f61e service nova] Acquiring lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a9cdace-80a0-4e9b-bfd6-c0c3eaa173fa req-f0c0a6e5-8c2f-46a8-812a-63cfbb51f61e service nova] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-2a9cdace-80a0-4e9b-bfd6-c0c3eaa173fa req-f0c0a6e5-8c2f-46a8-812a-63cfbb51f61e service nova] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.compute.manager [req-2a9cdace-80a0-4e9b-bfd6-c0c3eaa173fa req-f0c0a6e5-8c2f-46a8-812a-63cfbb51f61e service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] No waiting events found dispatching network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:10:09 user nova-compute[75288]: WARNING nova.compute.manager [req-2a9cdace-80a0-4e9b-bfd6-c0c3eaa173fa req-f0c0a6e5-8c2f-46a8-812a-63cfbb51f61e service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received unexpected event network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 for instance with vm_state building and task_state spawning.
Dec 01 14:10:09 user nova-compute[75288]: INFO nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Took 5.06 seconds to spawn the instance on the hypervisor.
Dec 01 14:10:09 user nova-compute[75288]: DEBUG nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:10:09 user nova-compute[75288]: INFO nova.compute.manager [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Took 5.75 seconds to build instance.
Dec 01 14:10:09 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-56f5b610-205d-4fa7-8a48-51faaa62db09 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.846s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid 29b2c407-8c8b-4722-8eec-b1dff1659960 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:10 user nova-compute[75288]: INFO nova.compute.manager [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Attaching volume b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 to /dev/vdb
Dec 01 14:10:10 user nova-compute[75288]: DEBUG os_brick.utils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[68511876-a01c-4c9b-8564-9e1bf7122200]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b329b10b-4ff5-4af8-a4cd-89a785135ee4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab269c3f-8dd9-4a63-ac8f-eb3516f4ab1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5c63b1-8226-4841-a915-ebb3fd0a81a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:10:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:10:11 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:10:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe81191-6ab3-483d-baba-8600d12567f4]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:10:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:10:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:10:11 user nova-compute[75288]: DEBUG os_brick.utils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:10:11 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updating existing volume attachment record: aa476abd-0a5b-4105-b749-108909b28328 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:10:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoVfgQYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:10:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:10:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:10:19 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:10:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:10:19 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee9d665-f059-4ae8-80f7-1d4818fdef57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:10:19 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18602188-ad2e-4f69-a22a-f2475d7290ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986] added
Dec 01 14:10:19 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4de4482-380c-4598-839b-615048bad0ed]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:19 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6232fb45-7555-4968-a5d0-66e0be30ab3e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoVfgQYT {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoVfgQYT" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[20045bba-1e97-4d51-9b03-d119a56009ec]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IoVfgQYT'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f2d2cf-f27e-455a-838c-905e98fbf52c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4271ca-f738-4eb1-a4d0-77ada5b2a818]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:10:20 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:10:20 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:10:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 14:10:20 user nova-compute[75288]: 
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[05420f7e-1447-4fae-8787-ef4ca742db06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986, portal: 172.16.0.220,3260]
Dec 01 14:10:20 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986, portal: 172.16.0.220,3260] successful.
Dec 01 14:10:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e2199e-4849-4db4-ac12-8ea3023c598a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b9aecc-10c0-4a3a-992b-9f0b82498d64]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[97792ecc-f948-4e58-93e5-33a4703fab93]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:10:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoVfgQYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23630656238333838', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630656238333838', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid 29b2c407-8c8b-4722-8eec-b1dff1659960 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:10:21 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:10:21 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:10:21 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:10:21 user nova-compute[75288]:   <serial>b1e7ad6f-7acd-49ef-9f8b-133eaefaa986</serial>
Dec 01 14:10:21 user nova-compute[75288]: </disk>
Dec 01 14:10:21 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No VIF found with MAC fa:16:3e:fd:0e:ac, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:10:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4760756f-7836-45f3-8440-d42d64545d92 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.030s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:10:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updating instance_info_cache with network_info: [{"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "215c2812-62ff-4adc-a8d6-47752792c409" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "215c2812-62ff-4adc-a8d6-47752792c409" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:10:25 user nova-compute[75288]: INFO nova.compute.claims [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Claim successful on node user
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:10:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.network.neutron [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:10:26 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.policy [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8674c9e9664e4122ae9966afdbebe365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6739624adb2547748e727a851ee65689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:10:26 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Creating image(s)
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "/opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "/opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "/opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:10:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8458MB free_disk=24.970230102539062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 29b2c407-8c8b-4722-8eec-b1dff1659960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 3bc5123a-6d10-445d-90ca-7cb920e0a729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 215c2812-62ff-4adc-a8d6-47752792c409 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk 1073741824" returned: 0 in 0.060s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG nova.network.neutron [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Successfully created port: ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Cannot resize image /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Ensure instance console log exists: /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:27 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Successfully updated port: ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquired lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-b5b2b90c-391a-42d3-b7d6-c92d9a08ac6a req-fae88aef-ef5a-431a-bf95-4b796eb59c60 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received event network-changed-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.compute.manager [req-b5b2b90c-391a-42d3-b7d6-c92d9a08ac6a req-fae88aef-ef5a-431a-bf95-4b796eb59c60 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Refreshing instance network info cache due to event network-changed-ceab006f-70ee-4fba-b993-7c64de4b682e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b5b2b90c-391a-42d3-b7d6-c92d9a08ac6a req-fae88aef-ef5a-431a-bf95-4b796eb59c60 service nova] Acquiring lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.neutron [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Updating instance_info_cache with network_info: [{"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Releasing lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Instance network_info: |[{"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b5b2b90c-391a-42d3-b7d6-c92d9a08ac6a req-fae88aef-ef5a-431a-bf95-4b796eb59c60 service nova] Acquired lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.neutron [req-b5b2b90c-391a-42d3-b7d6-c92d9a08ac6a req-fae88aef-ef5a-431a-bf95-4b796eb59c60 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Refreshing network info cache for port ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Start _get_guest_xml network_info=[{"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:10:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:10:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1167872116',display_name='tempest-AttachVolumeNegativeTest-server-1167872116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1167872116',id=45,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH1VMdCzrx4JoqeVsTGu2tjfKmrdaLfDloHqnGulncwmCPJ5GS3dusasjmpCgZMVWjaPdjAS/Mwr7cZsH8gQ77Ar3MYQoYtRSHiwhPCx4V6wpXmIxJkXdlNUfyEhqRJ5w==',key_name='tempest-keypair-1111946407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-dwmx9kd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=215c2812-62ff-4adc-a8d6-47752792c409,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:fb:25,bridge_name='br-int',has_traffic_filtering=True,id=ceab006f-70ee-4fba-b993-7c64de4b682e,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceab006f-70') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.objects.instance [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'pci_devices' on Instance uuid 215c2812-62ff-4adc-a8d6-47752792c409 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:10:28 user nova-compute[75288]:   <uuid>215c2812-62ff-4adc-a8d6-47752792c409</uuid>
Dec 01 14:10:28 user nova-compute[75288]:   <name>instance-0000002d</name>
Dec 01 14:10:28 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:10:28 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:10:28 user nova-compute[75288]:   <metadata>
Dec 01 14:10:28 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:10:28 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:10:28 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1167872116</nova:name>
Dec 01 14:10:28 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:10:28</nova:creationTime>
Dec 01 14:10:28 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:10:28 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:10:28 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:10:28 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:10:28 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:10:28 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:10:28 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:10:28 user nova-compute[75288]:       <nova:owner>
Dec 01 14:10:28 user nova-compute[75288]:         <nova:user uuid="8674c9e9664e4122ae9966afdbebe365">tempest-AttachVolumeNegativeTest-566842019-project-member</nova:user>
Dec 01 14:10:28 user nova-compute[75288]:         <nova:project uuid="6739624adb2547748e727a851ee65689">tempest-AttachVolumeNegativeTest-566842019</nova:project>
Dec 01 14:10:28 user nova-compute[75288]:       </nova:owner>
Dec 01 14:10:28 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:10:28 user nova-compute[75288]:       <nova:ports>
Dec 01 14:10:28 user nova-compute[75288]:         <nova:port uuid="ceab006f-70ee-4fba-b993-7c64de4b682e">
Dec 01 14:10:28 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 14:10:28 user nova-compute[75288]:         </nova:port>
Dec 01 14:10:28 user nova-compute[75288]:       </nova:ports>
Dec 01 14:10:28 user nova-compute[75288]:     </nova:instance>
Dec 01 14:10:28 user nova-compute[75288]:   </metadata>
Dec 01 14:10:28 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:10:28 user nova-compute[75288]:     <system>
Dec 01 14:10:28 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:10:28 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:10:28 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:10:28 user nova-compute[75288]:       <entry name="serial">215c2812-62ff-4adc-a8d6-47752792c409</entry>
Dec 01 14:10:28 user nova-compute[75288]:       <entry name="uuid">215c2812-62ff-4adc-a8d6-47752792c409</entry>
Dec 01 14:10:28 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:10:28 user nova-compute[75288]:     </system>
Dec 01 14:10:28 user nova-compute[75288]:   </sysinfo>
Dec 01 14:10:28 user nova-compute[75288]:   <os>
Dec 01 14:10:28 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:10:28 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:10:28 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:10:28 user nova-compute[75288]:   </os>
Dec 01 14:10:28 user nova-compute[75288]:   <features>
Dec 01 14:10:28 user nova-compute[75288]:     <acpi/>
Dec 01 14:10:28 user nova-compute[75288]:     <apic/>
Dec 01 14:10:28 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:10:28 user nova-compute[75288]:   </features>
Dec 01 14:10:28 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:10:28 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:10:28 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:10:28 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:10:28 user nova-compute[75288]:   </clock>
Dec 01 14:10:28 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:10:28 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:10:28 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:10:28 user nova-compute[75288]:   </cpu>
Dec 01 14:10:28 user nova-compute[75288]:   <devices>
Dec 01 14:10:28 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:10:28 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:10:28 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk"/>
Dec 01 14:10:28 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:10:28 user nova-compute[75288]:     </disk>
Dec 01 14:10:28 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:10:28 user nova-compute[75288]:       <mac address="fa:16:3e:83:fb:25"/>
Dec 01 14:10:28 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:10:28 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:10:28 user nova-compute[75288]:       <target dev="tapceab006f-70"/>
Dec 01 14:10:28 user nova-compute[75288]:     </interface>
Dec 01 14:10:28 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:10:28 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/console.log" append="off"/>
Dec 01 14:10:28 user nova-compute[75288]:     </serial>
Dec 01 14:10:28 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:10:28 user nova-compute[75288]:     <video>
Dec 01 14:10:28 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:10:28 user nova-compute[75288]:     </video>
Dec 01 14:10:28 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:10:28 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:10:28 user nova-compute[75288]:     </rng>
Dec 01 14:10:28 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:10:28 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:10:28 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:10:28 user nova-compute[75288]:     </memballoon>
Dec 01 14:10:28 user nova-compute[75288]:   </devices>
Dec 01 14:10:28 user nova-compute[75288]: </domain>
Dec 01 14:10:28 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1167872116',display_name='tempest-AttachVolumeNegativeTest-server-1167872116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1167872116',id=45,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH1VMdCzrx4JoqeVsTGu2tjfKmrdaLfDloHqnGulncwmCPJ5GS3dusasjmpCgZMVWjaPdjAS/Mwr7cZsH8gQ77Ar3MYQoYtRSHiwhPCx4V6wpXmIxJkXdlNUfyEhqRJ5w==',key_name='tempest-keypair-1111946407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-dwmx9kd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=215c2812-62ff-4adc-a8d6-47752792c409,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:fb:25,bridge_name='br-int',has_traffic_filtering=True,id=ceab006f-70ee-4fba-b993-7c64de4b682e,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceab006f-70') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG os_vif [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:fb:25,bridge_name='br-int',has_traffic_filtering=True,id=ceab006f-70ee-4fba-b993-7c64de4b682e,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceab006f-70') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6566600-0f93-5751-ba55-eaea3e0c48a8', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapceab006f-70, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapceab006f-70, col_values=(('qos', UUID('ff2f6a53-be5b-4cf4-92f2-fbe076931c0e')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapceab006f-70, col_values=(('external_ids', {'iface-id': 'ceab006f-70ee-4fba-b993-7c64de4b682e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:fb:25', 'vm-uuid': '215c2812-62ff-4adc-a8d6-47752792c409'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:28 user nova-compute[75288]: INFO os_vif [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:fb:25,bridge_name='br-int',has_traffic_filtering=True,id=ceab006f-70ee-4fba-b993-7c64de4b682e,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceab006f-70')
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No VIF found with MAC fa:16:3e:83:fb:25, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.neutron [req-b5b2b90c-391a-42d3-b7d6-c92d9a08ac6a req-fae88aef-ef5a-431a-bf95-4b796eb59c60 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Updated VIF entry in instance network info cache for port ceab006f-70ee-4fba-b993-7c64de4b682e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG nova.network.neutron [req-b5b2b90c-391a-42d3-b7d6-c92d9a08ac6a req-fae88aef-ef5a-431a-bf95-4b796eb59c60 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Updating instance_info_cache with network_info: [{"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b5b2b90c-391a-42d3-b7d6-c92d9a08ac6a req-fae88aef-ef5a-431a-bf95-4b796eb59c60 service nova] Releasing lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c768fef6-a813-4ae2-983d-bab2eb2e78ce req-076c7164-ce86-4ec8-8c1c-9565405b3d33 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received event network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c768fef6-a813-4ae2-983d-bab2eb2e78ce req-076c7164-ce86-4ec8-8c1c-9565405b3d33 service nova] Acquiring lock "215c2812-62ff-4adc-a8d6-47752792c409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c768fef6-a813-4ae2-983d-bab2eb2e78ce req-076c7164-ce86-4ec8-8c1c-9565405b3d33 service nova] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-c768fef6-a813-4ae2-983d-bab2eb2e78ce req-076c7164-ce86-4ec8-8c1c-9565405b3d33 service nova] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG nova.compute.manager [req-c768fef6-a813-4ae2-983d-bab2eb2e78ce req-076c7164-ce86-4ec8-8c1c-9565405b3d33 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] No waiting events found dispatching network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:10:30 user nova-compute[75288]: WARNING nova.compute.manager [req-c768fef6-a813-4ae2-983d-bab2eb2e78ce req-076c7164-ce86-4ec8-8c1c-9565405b3d33 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received unexpected event network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e for instance with vm_state building and task_state spawning.
Dec 01 14:10:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:30 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'flavor' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:31 user nova-compute[75288]: INFO nova.compute.manager [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Attaching volume 755d7f12-a2e8-488a-a97d-bd63e630a84d to /dev/vdb
Dec 01 14:10:31 user nova-compute[75288]: DEBUG os_brick.utils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9925ff-9ab7-4c05-accb-34fc3c14ce00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a5dc9a-4d67-4442-909a-e690e93d2d96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[10242906-7f0e-4c4a-9b73-4d5bc9d2cc80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c459a3-3bc9-4cc1-a71c-b7d9f4e989a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:10:31 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:10:31 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[064c442c-ee59-45a4-a8cd-9b5f1deab40b]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG os_brick.utils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:10:31 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating existing volume attachment record: 2ae24e05-7361-408e-b9dc-cccaf2ae601c {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:10:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Instance spawned successfully.
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:10:32 user nova-compute[75288]: INFO nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Took 5.70 seconds to spawn the instance on the hypervisor.
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-737eabf4-8891-46c6-ab6b-7c9e381a3b2b req-f33f0f40-886f-46c3-9a2a-018b9bcd69aa service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received event network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-737eabf4-8891-46c6-ab6b-7c9e381a3b2b req-f33f0f40-886f-46c3-9a2a-018b9bcd69aa service nova] Acquiring lock "215c2812-62ff-4adc-a8d6-47752792c409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-737eabf4-8891-46c6-ab6b-7c9e381a3b2b req-f33f0f40-886f-46c3-9a2a-018b9bcd69aa service nova] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-737eabf4-8891-46c6-ab6b-7c9e381a3b2b req-f33f0f40-886f-46c3-9a2a-018b9bcd69aa service nova] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:32 user nova-compute[75288]: DEBUG nova.compute.manager [req-737eabf4-8891-46c6-ab6b-7c9e381a3b2b req-f33f0f40-886f-46c3-9a2a-018b9bcd69aa service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] No waiting events found dispatching network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:10:32 user nova-compute[75288]: WARNING nova.compute.manager [req-737eabf4-8891-46c6-ab6b-7c9e381a3b2b req-f33f0f40-886f-46c3-9a2a-018b9bcd69aa service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received unexpected event network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e for instance with vm_state building and task_state spawning.
Dec 01 14:10:32 user nova-compute[75288]: INFO nova.compute.manager [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Took 7.07 seconds to build instance.
Dec 01 14:10:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-964c81a6-aff0-4885-9036-7450e5c3223e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "215c2812-62ff-4adc-a8d6-47752792c409" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.182s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:10:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:38 user nova-compute[75288]: INFO nova.compute.manager [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Terminating instance
Dec 01 14:10:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-1f0a951b-ed34-4dbc-af79-39a86a7b3342 req-2ee8a168-7e5f-4dd0-86f2-0375201399b2 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1f0a951b-ed34-4dbc-af79-39a86a7b3342 req-2ee8a168-7e5f-4dd0-86f2-0375201399b2 service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1f0a951b-ed34-4dbc-af79-39a86a7b3342 req-2ee8a168-7e5f-4dd0-86f2-0375201399b2 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1f0a951b-ed34-4dbc-af79-39a86a7b3342 req-2ee8a168-7e5f-4dd0-86f2-0375201399b2 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-1f0a951b-ed34-4dbc-af79-39a86a7b3342 req-2ee8a168-7e5f-4dd0-86f2-0375201399b2 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-1f0a951b-ed34-4dbc-af79-39a86a7b3342 req-2ee8a168-7e5f-4dd0-86f2-0375201399b2 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-unplugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:10:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Instance destroyed successfully.
Dec 01 14:10:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'resources' on Instance uuid ba42382c-6649-4dd3-8ef6-aee0f151fda3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:00:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1282332462',display_name='tempest-AttachVolumeTestJSON-server-1282332462',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1282332462',id=38,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4u4+GGfuoa6MrN95W99t+S/+vfskxE/fQqMyhAoVcqeR2gXp7NY+UrA+ycnL+K69KIv6OVG9qDxLCzrJeIMxVm0EP+owyMUz4uNXqcbv+Bmsm1vbWSlTIDtbqOSklPMQ==',key_name='tempest-keypair-83834141',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-symzd4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=ba42382c-6649-4dd3-8ef6-aee0f151fda3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "address": "fa:16:3e:18:bf:e4", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef8189f5-33", "ovs_interfaceid": "ef8189f5-33cb-4afa-9d8b-2890e86c9e28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG os_vif [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef8189f5-33, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7951746-f90d-48a2-b4ae-5bd70667c821) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:39 user nova-compute[75288]: INFO os_vif [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:bf:e4,bridge_name='br-int',has_traffic_filtering=True,id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef8189f5-33')
Dec 01 14:10:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Deleting instance files /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3_del
Dec 01 14:10:39 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Deletion of /opt/stack/data/nova/instances/ba42382c-6649-4dd3-8ef6-aee0f151fda3_del complete
Dec 01 14:10:39 user nova-compute[75288]: INFO nova.compute.manager [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 01 14:10:39 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNDEORHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:10:39 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:10:39 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:10:39 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3e7734-e9ee-4b60-a422-db5466f091e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:10:39 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[45029a5e-2874-4fca-b324-948b52711e04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d] added
Dec 01 14:10:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f10da62-20ce-4cae-a060-bf608523007f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e34f30d-f211-4216-aa9c-34664e994e9e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qNDEORHF {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Took 0.85 seconds to deallocate network for instance.
Dec 01 14:10:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-fd5b83fa-70f3-4315-bab1-7de697cdc0ce req-b229513f-9ce4-4724-a2a9-87cde412a15f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-deleted-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:40 user nova-compute[75288]: INFO nova.compute.manager [req-fd5b83fa-70f3-4315-bab1-7de697cdc0ce req-b229513f-9ce4-4724-a2a9-87cde412a15f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Neutron deleted interface ef8189f5-33cb-4afa-9d8b-2890e86c9e28; detaching it from the instance and deleting it from the info cache
Dec 01 14:10:40 user nova-compute[75288]: DEBUG nova.network.neutron [req-fd5b83fa-70f3-4315-bab1-7de697cdc0ce req-b229513f-9ce4-4724-a2a9-87cde412a15f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qNDEORHF" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40c6d2-6e17-4907-904a-c2380e6c5e0e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qNDEORHF'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-fd5b83fa-70f3-4315-bab1-7de697cdc0ce req-b229513f-9ce4-4724-a2a9-87cde412a15f service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Detach interface failed, port_id=ef8189f5-33cb-4afa-9d8b-2890e86c9e28, reason: Instance ba42382c-6649-4dd3-8ef6-aee0f151fda3 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373d80a-5a20-4de4-820b-e2f1ef8eb038]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0a60f4-159b-4467-99a7-59da55b60951]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad17e67-07ca-4b3c-b199-447f0d4e8e8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260]
Dec 01 14:10:40 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260] successful.
Dec 01 14:10:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c6ec34-74b5-442c-a239-b7c26135a807]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[55469e70-90de-4c6c-98a2-4bc73ff08f02]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:40 user nova-compute[75288]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)
Dec 01 14:10:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:40 user nova-compute[75288]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)
Dec 01 14:10:40 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d69e7ae-8a52-4eb4-b556-95bde76f26e7]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNDEORHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:40 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Deleted allocations for instance ba42382c-6649-4dd3-8ef6-aee0f151fda3
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-b3a85e07-6662-4c28-a80b-fe27d4277d9c tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-5ae9c23c-c8ff-4b40-ac88-644926346b94 req-e08a3481-8a8b-4926-a80d-62e5bc4ec9c9 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5ae9c23c-c8ff-4b40-ac88-644926346b94 req-e08a3481-8a8b-4926-a80d-62e5bc4ec9c9 service nova] Acquiring lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5ae9c23c-c8ff-4b40-ac88-644926346b94 req-e08a3481-8a8b-4926-a80d-62e5bc4ec9c9 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-5ae9c23c-c8ff-4b40-ac88-644926346b94 req-e08a3481-8a8b-4926-a80d-62e5bc4ec9c9 service nova] Lock "ba42382c-6649-4dd3-8ef6-aee0f151fda3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-5ae9c23c-c8ff-4b40-ac88-644926346b94 req-e08a3481-8a8b-4926-a80d-62e5bc4ec9c9 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] No waiting events found dispatching network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:10:40 user nova-compute[75288]: WARNING nova.compute.manager [req-5ae9c23c-c8ff-4b40-ac88-644926346b94 req-e08a3481-8a8b-4926-a80d-62e5bc4ec9c9 service nova] [instance: ba42382c-6649-4dd3-8ef6-aee0f151fda3] Received unexpected event network-vif-plugged-ef8189f5-33cb-4afa-9d8b-2890e86c9e28 for instance with vm_state deleted and task_state None.
Dec 01 14:10:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:10:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26263393132306664', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:10:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263393132306664', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:10:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'flavor' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:10:41 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:10:41 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:10:41 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:10:41 user nova-compute[75288]:   <serial>755d7f12-a2e8-488a-a97d-bd63e630a84d</serial>
Dec 01 14:10:41 user nova-compute[75288]: </disk>
Dec 01 14:10:41 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:10:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:10:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:10:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No VIF found with MAC fa:16:3e:a7:02:3e, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:10:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-9de1dca0-fb31-46b3-9f85-7b1390145d0c tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.701s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 29b2c407-8c8b-4722-8eec-b1dff1659960 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 3bc5123a-6d10-445d-90ca-7cb920e0a729 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 215c2812-62ff-4adc-a8d6-47752792c409 {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "215c2812-62ff-4adc-a8d6-47752792c409" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "215c2812-62ff-4adc-a8d6-47752792c409" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "215c2812-62ff-4adc-a8d6-47752792c409" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-206b72b6-8a26-48b9-9db8-6d5755a4197b req-6d9d6dc2-65f0-429a-bc00-2b7696f0e084 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-206b72b6-8a26-48b9-9db8-6d5755a4197b req-6d9d6dc2-65f0-429a-bc00-2b7696f0e084 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing instance network info cache due to event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-206b72b6-8a26-48b9-9db8-6d5755a4197b req-6d9d6dc2-65f0-429a-bc00-2b7696f0e084 service nova] Acquiring lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-206b72b6-8a26-48b9-9db8-6d5755a4197b req-6d9d6dc2-65f0-429a-bc00-2b7696f0e084 service nova] Acquired lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-206b72b6-8a26-48b9-9db8-6d5755a4197b req-6d9d6dc2-65f0-429a-bc00-2b7696f0e084 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-206b72b6-8a26-48b9-9db8-6d5755a4197b req-6d9d6dc2-65f0-429a-bc00-2b7696f0e084 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updated VIF entry in instance network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-206b72b6-8a26-48b9-9db8-6d5755a4197b req-6d9d6dc2-65f0-429a-bc00-2b7696f0e084 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-206b72b6-8a26-48b9-9db8-6d5755a4197b req-6d9d6dc2-65f0-429a-bc00-2b7696f0e084 service nova] Releasing lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-63e97c5f-9529-47c5-a1d8-d5d0b1778c69 req-ece9d113-4d93-4b9f-b32f-07a55282ddfa service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-63e97c5f-9529-47c5-a1d8-d5d0b1778c69 req-ece9d113-4d93-4b9f-b32f-07a55282ddfa service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing instance network info cache due to event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:10:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-63e97c5f-9529-47c5-a1d8-d5d0b1778c69 req-ece9d113-4d93-4b9f-b32f-07a55282ddfa service nova] Acquiring lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-63e97c5f-9529-47c5-a1d8-d5d0b1778c69 req-ece9d113-4d93-4b9f-b32f-07a55282ddfa service nova] Acquired lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-63e97c5f-9529-47c5-a1d8-d5d0b1778c69 req-ece9d113-4d93-4b9f-b32f-07a55282ddfa service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:10:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-63e97c5f-9529-47c5-a1d8-d5d0b1778c69 req-ece9d113-4d93-4b9f-b32f-07a55282ddfa service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updated VIF entry in instance network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:10:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-63e97c5f-9529-47c5-a1d8-d5d0b1778c69 req-ece9d113-4d93-4b9f-b32f-07a55282ddfa service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-63e97c5f-9529-47c5-a1d8-d5d0b1778c69 req-ece9d113-4d93-4b9f-b32f-07a55282ddfa service nova] Releasing lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:56 user nova-compute[75288]: INFO nova.compute.manager [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Rebooting instance
Dec 01 14:10:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquired lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Releasing lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-8880792a-a811-44be-b898-006ccc6e3e3d req-7688df8d-05af-4ae4-89d8-563121ddfc8e service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-unplugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8880792a-a811-44be-b898-006ccc6e3e3d req-7688df8d-05af-4ae4-89d8-563121ddfc8e service nova] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8880792a-a811-44be-b898-006ccc6e3e3d req-7688df8d-05af-4ae4-89d8-563121ddfc8e service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8880792a-a811-44be-b898-006ccc6e3e3d req-7688df8d-05af-4ae4-89d8-563121ddfc8e service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.compute.manager [req-8880792a-a811-44be-b898-006ccc6e3e3d req-7688df8d-05af-4ae4-89d8-563121ddfc8e service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] No waiting events found dispatching network-vif-unplugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:10:57 user nova-compute[75288]: WARNING nova.compute.manager [req-8880792a-a811-44be-b898-006ccc6e3e3d req-7688df8d-05af-4ae4-89d8-563121ddfc8e service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received unexpected event network-vif-unplugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa for instance with vm_state active and task_state reboot_started_hard.
Dec 01 14:10:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Instance destroyed successfully.
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'resources' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2033342625',display_name='tempest-TestMinimumBasicScenario-server-2033342625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2033342625',id=43,image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZR3GgEecmQd7suZ3Kuut7N5ZxRLtI7Epo/GolBsiosWZo+Z9jbNd/c2h/duv0WBExWj89HIOK1LbzjT6wNgKTBFwea/O7UnGbNmUIJNTXGMImJwVi6pE35H9+2eZMu9w==',key_name='tempest-TestMinimumBasicScenario-1390302078',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ewu3008a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:10:57Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=8a12810b-951d-49dd-b806-7f8f5450b0b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_vif [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5ca0ba9-dc, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab4c8d49-a374-48a5-8f01-9c9c0030d706) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:10:57 user nova-compute[75288]: INFO os_vif [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc')
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNDEORHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:10:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d21461-a2b5-4ff5-83f8-d471acba3c9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:10:57 user nova-compute[75288]: No targets found.
Dec 01 14:10:57 user nova-compute[75288]: iSNS:
Dec 01 14:10:57 user nova-compute[75288]: No targets found.
Dec 01 14:10:57 user nova-compute[75288]: STATIC:
Dec 01 14:10:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d
Dec 01 14:10:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:10:57 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:10:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986
Dec 01 14:10:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:10:57 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:10:57 user nova-compute[75288]: FIRMWARE:
Dec 01 14:10:57 user nova-compute[75288]: No targets found.
Dec 01 14:10:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:10:57 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:10:57 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae6fce3-e919-4606-a71c-4c53b037779b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed4d7a-6e2e-4424-8a31-3c086a0c7d66]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:57 user nova-compute[75288]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)
Dec 01 14:10:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:57 user nova-compute[75288]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)
Dec 01 14:10:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98b13130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af192ff-61e2-499b-8190-cd61063f3a25]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3677d34-0740-43d0-a0c2-c262c554a7a9]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d4c6b6-3517-40c7-8a73-c46c8eeb6f1a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a56743a-e5d0-40d2-a53a-a575a781cfb8]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd44cf7-26fe-4e81-a2c4-3f5b2a8fc4c4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a59b6b-2763-43f7-a01b-ca05eee47d6b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260]
Dec 01 14:10:57 user nova-compute[75288]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260] successful.
Dec 01 14:10:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e60ac1-7886-4f20-b7f4-2616d924a1ea]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] <== disconnect_volume: return (285ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Start _get_guest_xml network_info=[{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72279a56-d0d4-45ec-81b3-58c4f3232bbb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '72279a56-d0d4-45ec-81b3-58c4f3232bbb'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2ae24e05-7361-408e-b9dc-cccaf2ae601c', 'boot_index': None, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNDEORHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8a12810b-951d-49dd-b806-7f8f5450b0b5', 'attached_at': '', 'detached_at': '', 'volume_id': '755d7f12-a2e8-488a-a97d-bd63e630a84d', 'serial': '755d7f12-a2e8-488a-a97d-bd63e630a84d'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:10:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:10:57 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72279a56-d0d4-45ec-81b3-58c4f3232bbb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.objects.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Object Instance<8a12810b-951d-49dd-b806-7f8f5450b0b5> lazy-loaded attributes: resources,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNDEORHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:10:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:10:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:10:57 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5e5d4d-ee7e-47ea-b5b3-007a99381ef6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:10:57 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0445d6d5-7df9-4b00-ba0a-a5bd05f7e9a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d] added
Dec 01 14:10:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6910dcd-2a87-4e79-886e-f446962d129b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25cf691-1e33-4ab7-be3b-bacfe8cc7045]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qNDEORHF {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qNDEORHF" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4919cf-ab33-4777-9fa9-b4bbeb026e0b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qNDEORHF'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e584f1f-07ab-44f5-bde7-f36b3bd69d8f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ba588-7657-434d-a8fc-893a2f10125f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[86169e6b-7909-4277-a33c-eb19ca65fc84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260]
Dec 01 14:10:58 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260] successful.
Dec 01 14:10:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e5175-1c7c-4503-8f4c-a91ea4a335ef]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b696b492-ec4a-45fc-bcd5-9e1c86ee044e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:58 user nova-compute[75288]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)
Dec 01 14:10:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:10:58 user nova-compute[75288]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)
Dec 01 14:10:58 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86353af-30c9-4c16-92de-4ea86ba3968b]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:10:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNDEORHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-e9789eea-99bd-427c-a4b4-017bb9593a0c req-769b1034-6beb-4f59-85a7-e619ace3f6bc service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9789eea-99bd-427c-a4b4-017bb9593a0c req-769b1034-6beb-4f59-85a7-e619ace3f6bc service nova] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9789eea-99bd-427c-a4b4-017bb9593a0c req-769b1034-6beb-4f59-85a7-e619ace3f6bc service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e9789eea-99bd-427c-a4b4-017bb9593a0c req-769b1034-6beb-4f59-85a7-e619ace3f6bc service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.compute.manager [req-e9789eea-99bd-427c-a4b4-017bb9593a0c req-769b1034-6beb-4f59-85a7-e619ace3f6bc service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] No waiting events found dispatching network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:10:59 user nova-compute[75288]: WARNING nova.compute.manager [req-e9789eea-99bd-427c-a4b4-017bb9593a0c req-769b1034-6beb-4f59-85a7-e619ace3f6bc service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received unexpected event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa for instance with vm_state active and task_state reboot_started_hard.
Dec 01 14:10:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26263393132306664', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263393132306664', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2033342625',display_name='tempest-TestMinimumBasicScenario-server-2033342625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2033342625',id=43,image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZR3GgEecmQd7suZ3Kuut7N5ZxRLtI7Epo/GolBsiosWZo+Z9jbNd/c2h/duv0WBExWj89HIOK1LbzjT6wNgKTBFwea/O7UnGbNmUIJNTXGMImJwVi6pE35H9+2eZMu9w==',key_name='tempest-TestMinimumBasicScenario-1390302078',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ewu3008a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:10:57Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=8a12810b-951d-49dd-b806-7f8f5450b0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.objects.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Object Instance<8a12810b-951d-49dd-b806-7f8f5450b0b5> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:10:59 user nova-compute[75288]:   <uuid>8a12810b-951d-49dd-b806-7f8f5450b0b5</uuid>
Dec 01 14:10:59 user nova-compute[75288]:   <name>instance-0000002b</name>
Dec 01 14:10:59 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:10:59 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:10:59 user nova-compute[75288]:   <metadata>
Dec 01 14:10:59 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:10:59 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:10:59 user nova-compute[75288]:       <nova:name>tempest-TestMinimumBasicScenario-server-2033342625</nova:name>
Dec 01 14:10:59 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:10:57</nova:creationTime>
Dec 01 14:10:59 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:10:59 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:10:59 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:10:59 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:10:59 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:10:59 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:10:59 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:10:59 user nova-compute[75288]:       <nova:owner>
Dec 01 14:10:59 user nova-compute[75288]:         <nova:user uuid="02f74cb0fb13418b894e8517317bea9e">tempest-TestMinimumBasicScenario-652077982-project-member</nova:user>
Dec 01 14:10:59 user nova-compute[75288]:         <nova:project uuid="5fae7777bb784a55b159c88bc38e4fe9">tempest-TestMinimumBasicScenario-652077982</nova:project>
Dec 01 14:10:59 user nova-compute[75288]:       </nova:owner>
Dec 01 14:10:59 user nova-compute[75288]:       <nova:root type="image" uuid="72279a56-d0d4-45ec-81b3-58c4f3232bbb"/>
Dec 01 14:10:59 user nova-compute[75288]:       <nova:ports>
Dec 01 14:10:59 user nova-compute[75288]:         <nova:port uuid="c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa">
Dec 01 14:10:59 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 14:10:59 user nova-compute[75288]:         </nova:port>
Dec 01 14:10:59 user nova-compute[75288]:       </nova:ports>
Dec 01 14:10:59 user nova-compute[75288]:     </nova:instance>
Dec 01 14:10:59 user nova-compute[75288]:   </metadata>
Dec 01 14:10:59 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:10:59 user nova-compute[75288]:     <system>
Dec 01 14:10:59 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:10:59 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:10:59 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:10:59 user nova-compute[75288]:       <entry name="serial">8a12810b-951d-49dd-b806-7f8f5450b0b5</entry>
Dec 01 14:10:59 user nova-compute[75288]:       <entry name="uuid">8a12810b-951d-49dd-b806-7f8f5450b0b5</entry>
Dec 01 14:10:59 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:10:59 user nova-compute[75288]:     </system>
Dec 01 14:10:59 user nova-compute[75288]:   </sysinfo>
Dec 01 14:10:59 user nova-compute[75288]:   <os>
Dec 01 14:10:59 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:10:59 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:10:59 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:10:59 user nova-compute[75288]:   </os>
Dec 01 14:10:59 user nova-compute[75288]:   <features>
Dec 01 14:10:59 user nova-compute[75288]:     <acpi/>
Dec 01 14:10:59 user nova-compute[75288]:     <apic/>
Dec 01 14:10:59 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:10:59 user nova-compute[75288]:   </features>
Dec 01 14:10:59 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:10:59 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:10:59 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:10:59 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:10:59 user nova-compute[75288]:   </clock>
Dec 01 14:10:59 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:10:59 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:10:59 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:10:59 user nova-compute[75288]:   </cpu>
Dec 01 14:10:59 user nova-compute[75288]:   <devices>
Dec 01 14:10:59 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:10:59 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:10:59 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk"/>
Dec 01 14:10:59 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:10:59 user nova-compute[75288]:     </disk>
Dec 01 14:10:59 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 14:10:59 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:10:59 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Dec 01 14:10:59 user nova-compute[75288]:       <target dev="vdb" bus="virtio"/>
Dec 01 14:10:59 user nova-compute[75288]:       <serial>755d7f12-a2e8-488a-a97d-bd63e630a84d</serial>
Dec 01 14:10:59 user nova-compute[75288]:     </disk>
Dec 01 14:10:59 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:10:59 user nova-compute[75288]:       <mac address="fa:16:3e:a7:02:3e"/>
Dec 01 14:10:59 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:10:59 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:10:59 user nova-compute[75288]:       <target dev="tapc5ca0ba9-dc"/>
Dec 01 14:10:59 user nova-compute[75288]:     </interface>
Dec 01 14:10:59 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:10:59 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/console.log" append="off"/>
Dec 01 14:10:59 user nova-compute[75288]:     </serial>
Dec 01 14:10:59 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:10:59 user nova-compute[75288]:     <video>
Dec 01 14:10:59 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:10:59 user nova-compute[75288]:     </video>
Dec 01 14:10:59 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:10:59 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:10:59 user nova-compute[75288]:     </rng>
Dec 01 14:10:59 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:10:59 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:10:59 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:10:59 user nova-compute[75288]:     </memballoon>
Dec 01 14:10:59 user nova-compute[75288]:   </devices>
Dec 01 14:10:59 user nova-compute[75288]: </domain>
Dec 01 14:10:59 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.objects.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Object Instance<8a12810b-951d-49dd-b806-7f8f5450b0b5> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:10:59 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Cannot resize image /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'migration_context' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG nova.objects.base [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Object Instance<8a12810b-951d-49dd-b806-7f8f5450b0b5> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2033342625',display_name='tempest-TestMinimumBasicScenario-server-2033342625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2033342625',id=43,image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZR3GgEecmQd7suZ3Kuut7N5ZxRLtI7Epo/GolBsiosWZo+Z9jbNd/c2h/duv0WBExWj89HIOK1LbzjT6wNgKTBFwea/O7UnGbNmUIJNTXGMImJwVi6pE35H9+2eZMu9w==',key_name='tempest-TestMinimumBasicScenario-1390302078',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ewu3008a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:10:57Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=8a12810b-951d-49dd-b806-7f8f5450b0b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG os_vif [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18b9b958-138e-53ff-ba81-1cbf7780aa17', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5ca0ba9-dc, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5ca0ba9-dc, col_values=(('qos', UUID('cb1bef98-a759-4e37-b465-c0e2149b2193')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5ca0ba9-dc, col_values=(('external_ids', {'iface-id': 'c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:02:3e', 'vm-uuid': '8a12810b-951d-49dd-b806-7f8f5450b0b5'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:11:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:00 user nova-compute[75288]: INFO os_vif [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc')
Dec 01 14:11:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9e07515-4ba4-4bb9-9d44-acc3aed36090 req-fc20638a-0cc9-4f6c-aba7-132e3b6f4be9 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:11:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9e07515-4ba4-4bb9-9d44-acc3aed36090 req-fc20638a-0cc9-4f6c-aba7-132e3b6f4be9 service nova] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9e07515-4ba4-4bb9-9d44-acc3aed36090 req-fc20638a-0cc9-4f6c-aba7-132e3b6f4be9 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:01 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f9e07515-4ba4-4bb9-9d44-acc3aed36090 req-fc20638a-0cc9-4f6c-aba7-132e3b6f4be9 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:01 user nova-compute[75288]: DEBUG nova.compute.manager [req-f9e07515-4ba4-4bb9-9d44-acc3aed36090 req-fc20638a-0cc9-4f6c-aba7-132e3b6f4be9 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] No waiting events found dispatching network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:11:01 user nova-compute[75288]: WARNING nova.compute.manager [req-f9e07515-4ba4-4bb9-9d44-acc3aed36090 req-fc20638a-0cc9-4f6c-aba7-132e3b6f4be9 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received unexpected event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa for instance with vm_state active and task_state reboot_started_hard.
Dec 01 14:11:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:11:03 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Instance rebooted successfully.
Dec 01 14:11:03 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a0d5d5d1-60d1-4af3-9bf9-40f16f49e42f tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.355s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-06a92316-1a12-4362-b915-ccc915ffd120 req-f709ebea-6536-4742-ab78-13a820778b92 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-06a92316-1a12-4362-b915-ccc915ffd120 req-f709ebea-6536-4742-ab78-13a820778b92 service nova] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-06a92316-1a12-4362-b915-ccc915ffd120 req-f709ebea-6536-4742-ab78-13a820778b92 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:03 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-06a92316-1a12-4362-b915-ccc915ffd120 req-f709ebea-6536-4742-ab78-13a820778b92 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:03 user nova-compute[75288]: DEBUG nova.compute.manager [req-06a92316-1a12-4362-b915-ccc915ffd120 req-f709ebea-6536-4742-ab78-13a820778b92 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] No waiting events found dispatching network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:11:03 user nova-compute[75288]: WARNING nova.compute.manager [req-06a92316-1a12-4362-b915-ccc915ffd120 req-f709ebea-6536-4742-ab78-13a820778b92 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received unexpected event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa for instance with vm_state active and task_state None.
Dec 01 14:11:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:11:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:23 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 29b2c407-8c8b-4722-8eec-b1dff1659960 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updating instance_info_cache with network_info: [{"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-29b2c407-8c8b-4722-8eec-b1dff1659960" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:11:24 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:11:26 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8423MB free_disk=24.965221405029297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 29b2c407-8c8b-4722-8eec-b1dff1659960 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 3bc5123a-6d10-445d-90ca-7cb920e0a729 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 215c2812-62ff-4adc-a8d6-47752792c409 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:11:26 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:11:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:11:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:11:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:11:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:31 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:11:31 user nova-compute[75288]: INFO nova.compute.claims [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Claim successful on node user
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:11:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.policy [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ce70853828047c2a95d82b34f79cc96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d43be7c75dc4274801b9860ded7693d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:11:32 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Creating image(s)
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "/opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "/opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "/opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk 1073741824" returned: 0 in 0.048s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Successfully created port: 3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Cannot resize image /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Ensure instance console log exists: /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Successfully updated port: 3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquired lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-a037d100-2bf6-41fc-b86a-a22d6777ca10 req-3df9a474-40ed-4a4d-9b55-8b8c589903f4 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received event network-changed-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.compute.manager [req-a037d100-2bf6-41fc-b86a-a22d6777ca10 req-3df9a474-40ed-4a4d-9b55-8b8c589903f4 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Refreshing instance network info cache due to event network-changed-3f4fdb8d-aaca-4d48-912b-63b5e79671e7. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a037d100-2bf6-41fc-b86a-a22d6777ca10 req-3df9a474-40ed-4a4d-9b55-8b8c589903f4 service nova] Acquiring lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updating instance_info_cache with network_info: [{"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Releasing lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Instance network_info: |[{"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a037d100-2bf6-41fc-b86a-a22d6777ca10 req-3df9a474-40ed-4a4d-9b55-8b8c589903f4 service nova] Acquired lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-a037d100-2bf6-41fc-b86a-a22d6777ca10 req-3df9a474-40ed-4a4d-9b55-8b8c589903f4 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Refreshing network info cache for port 3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Start _get_guest_xml network_info=[{"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:11:34 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:11:34 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666197718',display_name='tempest-AttachVolumeTestJSON-server-666197718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666197718',id=46,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGGr5g/Ok1nSyHA61gFCD6qIK+SYhlfm+CZ6lM2J9F90t2G8b2lxcfsuyF3mFEA4rzT9jkJSBqTbR+2hb5i9PQH0J1ueQqTQfAOtafTcpQ4A/hHgTynmIrdkVlcyDgQ5w==',key_name='tempest-keypair-1957552402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-h0bbd2qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=48339b96-a50f-46d0-87d0-078ff6aab9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:19:31,bridge_name='br-int',has_traffic_filtering=True,id=3f4fdb8d-aaca-4d48-912b-63b5e79671e7,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4fdb8d-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'pci_devices' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:11:34 user nova-compute[75288]:   <uuid>48339b96-a50f-46d0-87d0-078ff6aab9fa</uuid>
Dec 01 14:11:34 user nova-compute[75288]:   <name>instance-0000002e</name>
Dec 01 14:11:34 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:11:34 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:11:34 user nova-compute[75288]:   <metadata>
Dec 01 14:11:34 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:11:34 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:11:34 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeTestJSON-server-666197718</nova:name>
Dec 01 14:11:34 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:11:34</nova:creationTime>
Dec 01 14:11:34 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:11:34 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:11:34 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:11:34 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:11:34 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:11:34 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:11:34 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:11:34 user nova-compute[75288]:       <nova:owner>
Dec 01 14:11:34 user nova-compute[75288]:         <nova:user uuid="9ce70853828047c2a95d82b34f79cc96">tempest-AttachVolumeTestJSON-800128847-project-member</nova:user>
Dec 01 14:11:34 user nova-compute[75288]:         <nova:project uuid="1d43be7c75dc4274801b9860ded7693d">tempest-AttachVolumeTestJSON-800128847</nova:project>
Dec 01 14:11:34 user nova-compute[75288]:       </nova:owner>
Dec 01 14:11:34 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:11:34 user nova-compute[75288]:       <nova:ports>
Dec 01 14:11:34 user nova-compute[75288]:         <nova:port uuid="3f4fdb8d-aaca-4d48-912b-63b5e79671e7">
Dec 01 14:11:34 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 14:11:34 user nova-compute[75288]:         </nova:port>
Dec 01 14:11:34 user nova-compute[75288]:       </nova:ports>
Dec 01 14:11:34 user nova-compute[75288]:     </nova:instance>
Dec 01 14:11:34 user nova-compute[75288]:   </metadata>
Dec 01 14:11:34 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:11:34 user nova-compute[75288]:     <system>
Dec 01 14:11:34 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:11:34 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:11:34 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:11:34 user nova-compute[75288]:       <entry name="serial">48339b96-a50f-46d0-87d0-078ff6aab9fa</entry>
Dec 01 14:11:34 user nova-compute[75288]:       <entry name="uuid">48339b96-a50f-46d0-87d0-078ff6aab9fa</entry>
Dec 01 14:11:34 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:11:34 user nova-compute[75288]:     </system>
Dec 01 14:11:34 user nova-compute[75288]:   </sysinfo>
Dec 01 14:11:34 user nova-compute[75288]:   <os>
Dec 01 14:11:34 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:11:34 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:11:34 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:11:34 user nova-compute[75288]:   </os>
Dec 01 14:11:34 user nova-compute[75288]:   <features>
Dec 01 14:11:34 user nova-compute[75288]:     <acpi/>
Dec 01 14:11:34 user nova-compute[75288]:     <apic/>
Dec 01 14:11:34 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:11:34 user nova-compute[75288]:   </features>
Dec 01 14:11:34 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:11:34 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:11:34 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:11:34 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:11:34 user nova-compute[75288]:   </clock>
Dec 01 14:11:34 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:11:34 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:11:34 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:11:34 user nova-compute[75288]:   </cpu>
Dec 01 14:11:34 user nova-compute[75288]:   <devices>
Dec 01 14:11:34 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:11:34 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:11:34 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk"/>
Dec 01 14:11:34 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:11:34 user nova-compute[75288]:     </disk>
Dec 01 14:11:34 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:11:34 user nova-compute[75288]:       <mac address="fa:16:3e:6e:19:31"/>
Dec 01 14:11:34 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:11:34 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:11:34 user nova-compute[75288]:       <target dev="tap3f4fdb8d-aa"/>
Dec 01 14:11:34 user nova-compute[75288]:     </interface>
Dec 01 14:11:34 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:11:34 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/console.log" append="off"/>
Dec 01 14:11:34 user nova-compute[75288]:     </serial>
Dec 01 14:11:34 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:11:34 user nova-compute[75288]:     <video>
Dec 01 14:11:34 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:11:34 user nova-compute[75288]:     </video>
Dec 01 14:11:34 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:11:34 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:11:34 user nova-compute[75288]:     </rng>
Dec 01 14:11:34 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:11:34 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:11:34 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:11:34 user nova-compute[75288]:     </memballoon>
Dec 01 14:11:34 user nova-compute[75288]:   </devices>
Dec 01 14:11:34 user nova-compute[75288]: </domain>
Dec 01 14:11:34 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666197718',display_name='tempest-AttachVolumeTestJSON-server-666197718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666197718',id=46,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGGr5g/Ok1nSyHA61gFCD6qIK+SYhlfm+CZ6lM2J9F90t2G8b2lxcfsuyF3mFEA4rzT9jkJSBqTbR+2hb5i9PQH0J1ueQqTQfAOtafTcpQ4A/hHgTynmIrdkVlcyDgQ5w==',key_name='tempest-keypair-1957552402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-h0bbd2qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=48339b96-a50f-46d0-87d0-078ff6aab9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:19:31,bridge_name='br-int',has_traffic_filtering=True,id=3f4fdb8d-aaca-4d48-912b-63b5e79671e7,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4fdb8d-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG os_vif [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:19:31,bridge_name='br-int',has_traffic_filtering=True,id=3f4fdb8d-aaca-4d48-912b-63b5e79671e7,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4fdb8d-aa') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '615b06ac-ccd8-5df2-9f8f-879515d306b7', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f4fdb8d-aa, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f4fdb8d-aa, col_values=(('qos', UUID('4c3a80dc-5f15-41ef-9530-cb1e89f43f80')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f4fdb8d-aa, col_values=(('external_ids', {'iface-id': '3f4fdb8d-aaca-4d48-912b-63b5e79671e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:19:31', 'vm-uuid': '48339b96-a50f-46d0-87d0-078ff6aab9fa'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:34 user nova-compute[75288]: INFO os_vif [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:19:31,bridge_name='br-int',has_traffic_filtering=True,id=3f4fdb8d-aaca-4d48-912b-63b5e79671e7,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4fdb8d-aa')
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No VIF found with MAC fa:16:3e:6e:19:31, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-a037d100-2bf6-41fc-b86a-a22d6777ca10 req-3df9a474-40ed-4a4d-9b55-8b8c589903f4 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updated VIF entry in instance network info cache for port 3f4fdb8d-aaca-4d48-912b-63b5e79671e7. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG nova.network.neutron [req-a037d100-2bf6-41fc-b86a-a22d6777ca10 req-3df9a474-40ed-4a4d-9b55-8b8c589903f4 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updating instance_info_cache with network_info: [{"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:11:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a037d100-2bf6-41fc-b86a-a22d6777ca10 req-3df9a474-40ed-4a4d-9b55-8b8c589903f4 service nova] Releasing lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-66b5fc98-5096-41ec-bbab-b6a84b038754 req-0630ee55-26e3-4311-84a6-ff43b1606f24 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received event network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66b5fc98-5096-41ec-bbab-b6a84b038754 req-0630ee55-26e3-4311-84a6-ff43b1606f24 service nova] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66b5fc98-5096-41ec-bbab-b6a84b038754 req-0630ee55-26e3-4311-84a6-ff43b1606f24 service nova] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-66b5fc98-5096-41ec-bbab-b6a84b038754 req-0630ee55-26e3-4311-84a6-ff43b1606f24 service nova] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-66b5fc98-5096-41ec-bbab-b6a84b038754 req-0630ee55-26e3-4311-84a6-ff43b1606f24 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] No waiting events found dispatching network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:11:35 user nova-compute[75288]: WARNING nova.compute.manager [req-66b5fc98-5096-41ec-bbab-b6a84b038754 req-0630ee55-26e3-4311-84a6-ff43b1606f24 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received unexpected event network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 for instance with vm_state building and task_state spawning.
Dec 01 14:11:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:11:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Instance spawned successfully.
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-4cf36ea6-0266-4fa4-97d7-1ffbef541d23 req-a1e8a136-602b-4547-a7f6-c49276aedd8f service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received event network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4cf36ea6-0266-4fa4-97d7-1ffbef541d23 req-a1e8a136-602b-4547-a7f6-c49276aedd8f service nova] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4cf36ea6-0266-4fa4-97d7-1ffbef541d23 req-a1e8a136-602b-4547-a7f6-c49276aedd8f service nova] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4cf36ea6-0266-4fa4-97d7-1ffbef541d23 req-a1e8a136-602b-4547-a7f6-c49276aedd8f service nova] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-4cf36ea6-0266-4fa4-97d7-1ffbef541d23 req-a1e8a136-602b-4547-a7f6-c49276aedd8f service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] No waiting events found dispatching network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:11:37 user nova-compute[75288]: WARNING nova.compute.manager [req-4cf36ea6-0266-4fa4-97d7-1ffbef541d23 req-a1e8a136-602b-4547-a7f6-c49276aedd8f service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received unexpected event network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 for instance with vm_state building and task_state spawning.
Dec 01 14:11:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:38 user nova-compute[75288]: INFO nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Took 5.62 seconds to spawn the instance on the hypervisor.
Dec 01 14:11:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:11:38 user nova-compute[75288]: INFO nova.compute.manager [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Took 6.23 seconds to build instance.
Dec 01 14:11:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d93a8f55-ae43-4b97-ba3f-dd26671da076 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.343s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:11:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:54 user nova-compute[75288]: INFO nova.compute.manager [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Terminating instance
Dec 01 14:11:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-8a3cef3d-0540-46f7-879b-1b4915dd22e4 req-fc5d9f1b-7fa3-4dba-a64f-8116b336de09 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received event network-vif-unplugged-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8a3cef3d-0540-46f7-879b-1b4915dd22e4 req-fc5d9f1b-7fa3-4dba-a64f-8116b336de09 service nova] Acquiring lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8a3cef3d-0540-46f7-879b-1b4915dd22e4 req-fc5d9f1b-7fa3-4dba-a64f-8116b336de09 service nova] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8a3cef3d-0540-46f7-879b-1b4915dd22e4 req-fc5d9f1b-7fa3-4dba-a64f-8116b336de09 service nova] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-8a3cef3d-0540-46f7-879b-1b4915dd22e4 req-fc5d9f1b-7fa3-4dba-a64f-8116b336de09 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] No waiting events found dispatching network-vif-unplugged-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:11:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-8a3cef3d-0540-46f7-879b-1b4915dd22e4 req-fc5d9f1b-7fa3-4dba-a64f-8116b336de09 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received event network-vif-unplugged-a195854e-04a0-4548-8cee-35945bbd80c3 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Instance destroyed successfully.
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.objects.instance [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lazy-loading 'resources' on Instance uuid 3bc5123a-6d10-445d-90ca-7cb920e0a729 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:10:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1037537926',display_name='tempest-VolumesActionsTest-instance-1037537926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1037537926',id=44,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:10:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c81faa0ffc4f8881312e037ca7ac3a',ramdisk_id='',reservation_id='r-z5e89nle',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1772844408',owner_user_name='tempest-VolumesActionsTest-1772844408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:10:10Z,user_data=None,user_id='e0c1c4feb6d448ffa4032d725206e293',uuid=3bc5123a-6d10-445d-90ca-7cb920e0a729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converting VIF {"id": "a195854e-04a0-4548-8cee-35945bbd80c3", "address": "fa:16:3e:f3:63:a4", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa195854e-04", "ovs_interfaceid": "a195854e-04a0-4548-8cee-35945bbd80c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:63:a4,bridge_name='br-int',has_traffic_filtering=True,id=a195854e-04a0-4548-8cee-35945bbd80c3,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa195854e-04') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG os_vif [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:63:a4,bridge_name='br-int',has_traffic_filtering=True,id=a195854e-04a0-4548-8cee-35945bbd80c3,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa195854e-04') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa195854e-04, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=544c53da-ab54-4c6f-b456-06553433c0f2) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:11:55 user nova-compute[75288]: INFO os_vif [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:63:a4,bridge_name='br-int',has_traffic_filtering=True,id=a195854e-04a0-4548-8cee-35945bbd80c3,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa195854e-04')
Dec 01 14:11:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Deleting instance files /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729_del
Dec 01 14:11:55 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Deletion of /opt/stack/data/nova/instances/3bc5123a-6d10-445d-90ca-7cb920e0a729_del complete
Dec 01 14:11:55 user nova-compute[75288]: INFO nova.compute.manager [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 01 14:11:55 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-5de7a7bf-6dd7-4619-913e-3e4cc8fc2c42 req-211d744c-da75-4789-b79b-54dd92349317 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received event network-vif-deleted-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:11:55 user nova-compute[75288]: INFO nova.compute.manager [req-5de7a7bf-6dd7-4619-913e-3e4cc8fc2c42 req-211d744c-da75-4789-b79b-54dd92349317 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Neutron deleted interface a195854e-04a0-4548-8cee-35945bbd80c3; detaching it from the instance and deleting it from the info cache
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.network.neutron [req-5de7a7bf-6dd7-4619-913e-3e4cc8fc2c42 req-211d744c-da75-4789-b79b-54dd92349317 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:11:55 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Took 0.47 seconds to deallocate network for instance.
Dec 01 14:11:55 user nova-compute[75288]: DEBUG nova.compute.manager [req-5de7a7bf-6dd7-4619-913e-3e4cc8fc2c42 req-211d744c-da75-4789-b79b-54dd92349317 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Detach interface failed, port_id=a195854e-04a0-4548-8cee-35945bbd80c3, reason: Instance 3bc5123a-6d10-445d-90ca-7cb920e0a729 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:56 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Deleted allocations for instance 3bc5123a-6d10-445d-90ca-7cb920e0a729
Dec 01 14:11:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-07c1f953-0b3f-41db-a172-32cddf4d95b0 tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.733s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-35e0689a-fd73-4797-90ee-52d6a2406d5f req-d07af488-f486-42d4-9aad-5a6f0c07ac62 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received event network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-35e0689a-fd73-4797-90ee-52d6a2406d5f req-d07af488-f486-42d4-9aad-5a6f0c07ac62 service nova] Acquiring lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-35e0689a-fd73-4797-90ee-52d6a2406d5f req-d07af488-f486-42d4-9aad-5a6f0c07ac62 service nova] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-35e0689a-fd73-4797-90ee-52d6a2406d5f req-d07af488-f486-42d4-9aad-5a6f0c07ac62 service nova] Lock "3bc5123a-6d10-445d-90ca-7cb920e0a729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:11:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-35e0689a-fd73-4797-90ee-52d6a2406d5f req-d07af488-f486-42d4-9aad-5a6f0c07ac62 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] No waiting events found dispatching network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:11:56 user nova-compute[75288]: WARNING nova.compute.manager [req-35e0689a-fd73-4797-90ee-52d6a2406d5f req-d07af488-f486-42d4-9aad-5a6f0c07ac62 service nova] [instance: 3bc5123a-6d10-445d-90ca-7cb920e0a729] Received unexpected event network-vif-plugged-a195854e-04a0-4548-8cee-35945bbd80c3 for instance with vm_state deleted and task_state None.
Dec 01 14:11:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-de3db197-6f92-4599-9e79-9bbfd7c85a02 req-689d04a4-4911-4164-9f8a-cd80b2ac74e2 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received event network-changed-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG nova.compute.manager [req-de3db197-6f92-4599-9e79-9bbfd7c85a02 req-689d04a4-4911-4164-9f8a-cd80b2ac74e2 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Refreshing instance network info cache due to event network-changed-ceab006f-70ee-4fba-b993-7c64de4b682e. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de3db197-6f92-4599-9e79-9bbfd7c85a02 req-689d04a4-4911-4164-9f8a-cd80b2ac74e2 service nova] Acquiring lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de3db197-6f92-4599-9e79-9bbfd7c85a02 req-689d04a4-4911-4164-9f8a-cd80b2ac74e2 service nova] Acquired lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG nova.network.neutron [req-de3db197-6f92-4599-9e79-9bbfd7c85a02 req-689d04a4-4911-4164-9f8a-cd80b2ac74e2 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Refreshing network info cache for port ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "215c2812-62ff-4adc-a8d6-47752792c409" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "215c2812-62ff-4adc-a8d6-47752792c409" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "215c2812-62ff-4adc-a8d6-47752792c409-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:16 user nova-compute[75288]: INFO nova.compute.manager [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Terminating instance
Dec 01 14:12:16 user nova-compute[75288]: DEBUG nova.compute.manager [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG nova.network.neutron [req-de3db197-6f92-4599-9e79-9bbfd7c85a02 req-689d04a4-4911-4164-9f8a-cd80b2ac74e2 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Updated VIF entry in instance network info cache for port ceab006f-70ee-4fba-b993-7c64de4b682e. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG nova.network.neutron [req-de3db197-6f92-4599-9e79-9bbfd7c85a02 req-689d04a4-4911-4164-9f8a-cd80b2ac74e2 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Updating instance_info_cache with network_info: [{"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-de3db197-6f92-4599-9e79-9bbfd7c85a02 req-689d04a4-4911-4164-9f8a-cd80b2ac74e2 service nova] Releasing lock "refresh_cache-215c2812-62ff-4adc-a8d6-47752792c409" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Instance destroyed successfully.
Dec 01 14:12:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'resources' on Instance uuid 215c2812-62ff-4adc-a8d6-47752792c409 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:10:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1167872116',display_name='tempest-AttachVolumeNegativeTest-server-1167872116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1167872116',id=45,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJH1VMdCzrx4JoqeVsTGu2tjfKmrdaLfDloHqnGulncwmCPJ5GS3dusasjmpCgZMVWjaPdjAS/Mwr7cZsH8gQ77Ar3MYQoYtRSHiwhPCx4V6wpXmIxJkXdlNUfyEhqRJ5w==',key_name='tempest-keypair-1111946407',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:10:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-dwmx9kd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=215c2812-62ff-4adc-a8d6-47752792c409,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "ceab006f-70ee-4fba-b993-7c64de4b682e", "address": "fa:16:3e:83:fb:25", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapceab006f-70", "ovs_interfaceid": "ceab006f-70ee-4fba-b993-7c64de4b682e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:fb:25,bridge_name='br-int',has_traffic_filtering=True,id=ceab006f-70ee-4fba-b993-7c64de4b682e,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceab006f-70') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG os_vif [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:fb:25,bridge_name='br-int',has_traffic_filtering=True,id=ceab006f-70ee-4fba-b993-7c64de4b682e,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceab006f-70') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapceab006f-70, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff2f6a53-be5b-4cf4-92f2-fbe076931c0e) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:12:17 user nova-compute[75288]: INFO os_vif [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:fb:25,bridge_name='br-int',has_traffic_filtering=True,id=ceab006f-70ee-4fba-b993-7c64de4b682e,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceab006f-70')
Dec 01 14:12:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Deleting instance files /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409_del
Dec 01 14:12:17 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Deletion of /opt/stack/data/nova/instances/215c2812-62ff-4adc-a8d6-47752792c409_del complete
Dec 01 14:12:17 user nova-compute[75288]: INFO nova.compute.manager [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Took 0.82 seconds to destroy the instance on the hypervisor.
Dec 01 14:12:17 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:12:17 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:12:18 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Took 0.66 seconds to deallocate network for instance.
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-48f8d1ff-52f8-4d35-81be-e620aa1d5183 req-0d714159-69c4-4025-a9d0-c7bf195739b0 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received event network-vif-deleted-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:18 user nova-compute[75288]: INFO nova.compute.manager [req-48f8d1ff-52f8-4d35-81be-e620aa1d5183 req-0d714159-69c4-4025-a9d0-c7bf195739b0 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Neutron deleted interface ceab006f-70ee-4fba-b993-7c64de4b682e; detaching it from the instance and deleting it from the info cache
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.network.neutron [req-48f8d1ff-52f8-4d35-81be-e620aa1d5183 req-0d714159-69c4-4025-a9d0-c7bf195739b0 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-48f8d1ff-52f8-4d35-81be-e620aa1d5183 req-0d714159-69c4-4025-a9d0-c7bf195739b0 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Detach interface failed, port_id=ceab006f-70ee-4fba-b993-7c64de4b682e, reason: Instance 215c2812-62ff-4adc-a8d6-47752792c409 could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received event network-vif-unplugged-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] Acquiring lock "215c2812-62ff-4adc-a8d6-47752792c409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] No waiting events found dispatching network-vif-unplugged-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:12:18 user nova-compute[75288]: WARNING nova.compute.manager [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received unexpected event network-vif-unplugged-ceab006f-70ee-4fba-b993-7c64de4b682e for instance with vm_state deleted and task_state None.
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received event network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] Acquiring lock "215c2812-62ff-4adc-a8d6-47752792c409-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] Lock "215c2812-62ff-4adc-a8d6-47752792c409-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] No waiting events found dispatching network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:12:18 user nova-compute[75288]: WARNING nova.compute.manager [req-41f3e687-5fcb-4262-87f4-756909f159a1 req-60dca634-2745-4beb-83dc-5218eae36ae8 service nova] [instance: 215c2812-62ff-4adc-a8d6-47752792c409] Received unexpected event network-vif-plugged-ceab006f-70ee-4fba-b993-7c64de4b682e for instance with vm_state deleted and task_state None.
Dec 01 14:12:18 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:18 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Deleted allocations for instance 215c2812-62ff-4adc-a8d6-47752792c409
Dec 01 14:12:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-e2f910d6-ad94-4f80-b1df-fc3c50432876 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "215c2812-62ff-4adc-a8d6-47752792c409" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.855s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:12:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:12:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8613MB free_disk=24.982929229736328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 29b2c407-8c8b-4722-8eec-b1dff1659960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 48339b96-a50f-46d0-87d0-078ff6aab9fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:12:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:12:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:12:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "6d835111-787d-4968-b8a6-f1584a857cad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "6d835111-787d-4968-b8a6-f1584a857cad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:12:46 user nova-compute[75288]: INFO nova.compute.claims [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Claim successful on node user
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:12:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.policy [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0c1c4feb6d448ffa4032d725206e293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c81faa0ffc4f8881312e037ca7ac3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:12:46 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Creating image(s)
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "/opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "/opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.188s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk 1073741824" returned: 0 in 0.055s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Successfully created port: 4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Cannot resize image /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Ensure instance console log exists: /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Successfully updated port: 4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "refresh_cache-6d835111-787d-4968-b8a6-f1584a857cad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquired lock "refresh_cache-6d835111-787d-4968-b8a6-f1584a857cad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-4a5eab80-ac54-4856-9633-81e4fdaa4f7a req-7ed0d1a2-d5c5-492a-86b5-3b5fa0622cc2 service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received event network-changed-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-4a5eab80-ac54-4856-9633-81e4fdaa4f7a req-7ed0d1a2-d5c5-492a-86b5-3b5fa0622cc2 service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Refreshing instance network info cache due to event network-changed-4c90cba1-3038-4f63-b6b5-c94f597037ad. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4a5eab80-ac54-4856-9633-81e4fdaa4f7a req-7ed0d1a2-d5c5-492a-86b5-3b5fa0622cc2 service nova] Acquiring lock "refresh_cache-6d835111-787d-4968-b8a6-f1584a857cad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-6245f02e-6033-4d42-972a-b613231441cd req-6a37f730-bc5f-4fc1-8b8d-1545fbd79005 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-6245f02e-6033-4d42-972a-b613231441cd req-6a37f730-bc5f-4fc1-8b8d-1545fbd79005 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing instance network info cache due to event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6245f02e-6033-4d42-972a-b613231441cd req-6a37f730-bc5f-4fc1-8b8d-1545fbd79005 service nova] Acquiring lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6245f02e-6033-4d42-972a-b613231441cd req-6a37f730-bc5f-4fc1-8b8d-1545fbd79005 service nova] Acquired lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-6245f02e-6033-4d42-972a-b613231441cd req-6a37f730-bc5f-4fc1-8b8d-1545fbd79005 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Updating instance_info_cache with network_info: [{"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Releasing lock "refresh_cache-6d835111-787d-4968-b8a6-f1584a857cad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Instance network_info: |[{"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4a5eab80-ac54-4856-9633-81e4fdaa4f7a req-7ed0d1a2-d5c5-492a-86b5-3b5fa0622cc2 service nova] Acquired lock "refresh_cache-6d835111-787d-4968-b8a6-f1584a857cad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-4a5eab80-ac54-4856-9633-81e4fdaa4f7a req-7ed0d1a2-d5c5-492a-86b5-3b5fa0622cc2 service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Refreshing network info cache for port 4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Start _get_guest_xml network_info=[{"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:12:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:12:48 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1406921414',display_name='tempest-VolumesActionsTest-instance-1406921414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1406921414',id=47,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c81faa0ffc4f8881312e037ca7ac3a',ramdisk_id='',reservation_id='r-l09lwklx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1772844408',owner_user_name='tempest-VolumesActionsTest-1772844408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:12:47Z,user_data=None,user_id='e0c1c4feb6d448ffa4032d725206e293',uuid=6d835111-787d-4968-b8a6-f1584a857cad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converting VIF {"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:6b:78,bridge_name='br-int',has_traffic_filtering=True,id=4c90cba1-3038-4f63-b6b5-c94f597037ad,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90cba1-30') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.objects.instance [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d835111-787d-4968-b8a6-f1584a857cad {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:12:48 user nova-compute[75288]:   <uuid>6d835111-787d-4968-b8a6-f1584a857cad</uuid>
Dec 01 14:12:48 user nova-compute[75288]:   <name>instance-0000002f</name>
Dec 01 14:12:48 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:12:48 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:12:48 user nova-compute[75288]:   <metadata>
Dec 01 14:12:48 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:12:48 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:12:48 user nova-compute[75288]:       <nova:name>tempest-VolumesActionsTest-instance-1406921414</nova:name>
Dec 01 14:12:48 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:12:48</nova:creationTime>
Dec 01 14:12:48 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:12:48 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:12:48 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:12:48 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:12:48 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:12:48 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:12:48 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:12:48 user nova-compute[75288]:       <nova:owner>
Dec 01 14:12:48 user nova-compute[75288]:         <nova:user uuid="e0c1c4feb6d448ffa4032d725206e293">tempest-VolumesActionsTest-1772844408-project-member</nova:user>
Dec 01 14:12:48 user nova-compute[75288]:         <nova:project uuid="77c81faa0ffc4f8881312e037ca7ac3a">tempest-VolumesActionsTest-1772844408</nova:project>
Dec 01 14:12:48 user nova-compute[75288]:       </nova:owner>
Dec 01 14:12:48 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:12:48 user nova-compute[75288]:       <nova:ports>
Dec 01 14:12:48 user nova-compute[75288]:         <nova:port uuid="4c90cba1-3038-4f63-b6b5-c94f597037ad">
Dec 01 14:12:48 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 14:12:48 user nova-compute[75288]:         </nova:port>
Dec 01 14:12:48 user nova-compute[75288]:       </nova:ports>
Dec 01 14:12:48 user nova-compute[75288]:     </nova:instance>
Dec 01 14:12:48 user nova-compute[75288]:   </metadata>
Dec 01 14:12:48 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:12:48 user nova-compute[75288]:     <system>
Dec 01 14:12:48 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:12:48 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:12:48 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:12:48 user nova-compute[75288]:       <entry name="serial">6d835111-787d-4968-b8a6-f1584a857cad</entry>
Dec 01 14:12:48 user nova-compute[75288]:       <entry name="uuid">6d835111-787d-4968-b8a6-f1584a857cad</entry>
Dec 01 14:12:48 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:12:48 user nova-compute[75288]:     </system>
Dec 01 14:12:48 user nova-compute[75288]:   </sysinfo>
Dec 01 14:12:48 user nova-compute[75288]:   <os>
Dec 01 14:12:48 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:12:48 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:12:48 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:12:48 user nova-compute[75288]:   </os>
Dec 01 14:12:48 user nova-compute[75288]:   <features>
Dec 01 14:12:48 user nova-compute[75288]:     <acpi/>
Dec 01 14:12:48 user nova-compute[75288]:     <apic/>
Dec 01 14:12:48 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:12:48 user nova-compute[75288]:   </features>
Dec 01 14:12:48 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:12:48 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:12:48 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:12:48 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:12:48 user nova-compute[75288]:   </clock>
Dec 01 14:12:48 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:12:48 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:12:48 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:12:48 user nova-compute[75288]:   </cpu>
Dec 01 14:12:48 user nova-compute[75288]:   <devices>
Dec 01 14:12:48 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:12:48 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:12:48 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk"/>
Dec 01 14:12:48 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:12:48 user nova-compute[75288]:     </disk>
Dec 01 14:12:48 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:12:48 user nova-compute[75288]:       <mac address="fa:16:3e:b7:6b:78"/>
Dec 01 14:12:48 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:12:48 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:12:48 user nova-compute[75288]:       <target dev="tap4c90cba1-30"/>
Dec 01 14:12:48 user nova-compute[75288]:     </interface>
Dec 01 14:12:48 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:12:48 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/console.log" append="off"/>
Dec 01 14:12:48 user nova-compute[75288]:     </serial>
Dec 01 14:12:48 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:12:48 user nova-compute[75288]:     <video>
Dec 01 14:12:48 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:12:48 user nova-compute[75288]:     </video>
Dec 01 14:12:48 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:12:48 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:12:48 user nova-compute[75288]:     </rng>
Dec 01 14:12:48 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:12:48 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:12:48 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:12:48 user nova-compute[75288]:     </memballoon>
Dec 01 14:12:48 user nova-compute[75288]:   </devices>
Dec 01 14:12:48 user nova-compute[75288]: </domain>
Dec 01 14:12:48 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1406921414',display_name='tempest-VolumesActionsTest-instance-1406921414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1406921414',id=47,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c81faa0ffc4f8881312e037ca7ac3a',ramdisk_id='',reservation_id='r-l09lwklx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1772844408',owner_user_name='tempest-VolumesActionsTest-1772844408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:12:47Z,user_data=None,user_id='e0c1c4feb6d448ffa4032d725206e293',uuid=6d835111-787d-4968-b8a6-f1584a857cad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converting VIF {"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:6b:78,bridge_name='br-int',has_traffic_filtering=True,id=4c90cba1-3038-4f63-b6b5-c94f597037ad,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90cba1-30') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG os_vif [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:6b:78,bridge_name='br-int',has_traffic_filtering=True,id=4c90cba1-3038-4f63-b6b5-c94f597037ad,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90cba1-30') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b75dfeee-5903-50ca-90b9-325c12843b11', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c90cba1-30, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c90cba1-30, col_values=(('qos', UUID('358393c1-5a8b-46d6-8af1-001d7b8c4641')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c90cba1-30, col_values=(('external_ids', {'iface-id': '4c90cba1-3038-4f63-b6b5-c94f597037ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:6b:78', 'vm-uuid': '6d835111-787d-4968-b8a6-f1584a857cad'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:48 user nova-compute[75288]: INFO os_vif [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:6b:78,bridge_name='br-int',has_traffic_filtering=True,id=4c90cba1-3038-4f63-b6b5-c94f597037ad,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90cba1-30')
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] No VIF found with MAC fa:16:3e:b7:6b:78, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-6245f02e-6033-4d42-972a-b613231441cd req-6a37f730-bc5f-4fc1-8b8d-1545fbd79005 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updated VIF entry in instance network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-6245f02e-6033-4d42-972a-b613231441cd req-6a37f730-bc5f-4fc1-8b8d-1545fbd79005 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6245f02e-6033-4d42-972a-b613231441cd req-6a37f730-bc5f-4fc1-8b8d-1545fbd79005 service nova] Releasing lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-4a5eab80-ac54-4856-9633-81e4fdaa4f7a req-7ed0d1a2-d5c5-492a-86b5-3b5fa0622cc2 service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Updated VIF entry in instance network info cache for port 4c90cba1-3038-4f63-b6b5-c94f597037ad. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG nova.network.neutron [req-4a5eab80-ac54-4856-9633-81e4fdaa4f7a req-7ed0d1a2-d5c5-492a-86b5-3b5fa0622cc2 service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Updating instance_info_cache with network_info: [{"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:12:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4a5eab80-ac54-4856-9633-81e4fdaa4f7a req-7ed0d1a2-d5c5-492a-86b5-3b5fa0622cc2 service nova] Releasing lock "refresh_cache-6d835111-787d-4968-b8a6-f1584a857cad" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:12:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:49 user nova-compute[75288]: INFO nova.compute.manager [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Detaching volume 755d7f12-a2e8-488a-a97d-bd63e630a84d
Dec 01 14:12:49 user nova-compute[75288]: INFO nova.virt.block_device [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Attempting to driver detach volume 755d7f12-a2e8-488a-a97d-bd63e630a84d from mountpoint /dev/vdb
Dec 01 14:12:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Attempting to detach device vdb from instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:12:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:12:49 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:12:49 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:12:49 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:12:49 user nova-compute[75288]:   <serial>755d7f12-a2e8-488a-a97d-bd63e630a84d</serial>
Dec 01 14:12:49 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 14:12:49 user nova-compute[75288]: </disk>
Dec 01 14:12:49 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:12:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully detached device vdb from instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 from the persistent domain config.
Dec 01 14:12:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:12:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:12:49 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:12:49 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:12:49 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:12:49 user nova-compute[75288]:   <serial>755d7f12-a2e8-488a-a97d-bd63e630a84d</serial>
Dec 01 14:12:49 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 14:12:49 user nova-compute[75288]: </disk>
Dec 01 14:12:49 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:12:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-3da5e82b-d02e-4a4a-8094-491d69db4924 req-fd75cbcf-dba0-43f8-93de-39b4c3e15faf service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received event network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3da5e82b-d02e-4a4a-8094-491d69db4924 req-fd75cbcf-dba0-43f8-93de-39b4c3e15faf service nova] Acquiring lock "6d835111-787d-4968-b8a6-f1584a857cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3da5e82b-d02e-4a4a-8094-491d69db4924 req-fd75cbcf-dba0-43f8-93de-39b4c3e15faf service nova] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3da5e82b-d02e-4a4a-8094-491d69db4924 req-fd75cbcf-dba0-43f8-93de-39b4c3e15faf service nova] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-3da5e82b-d02e-4a4a-8094-491d69db4924 req-fd75cbcf-dba0-43f8-93de-39b4c3e15faf service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] No waiting events found dispatching network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:12:50 user nova-compute[75288]: WARNING nova.compute.manager [req-3da5e82b-d02e-4a4a-8094-491d69db4924 req-fd75cbcf-dba0-43f8-93de-39b4c3e15faf service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received unexpected event network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad for instance with vm_state building and task_state spawning.
Dec 01 14:12:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-4644c6c1-26f5-46e9-a673-8a68779a0d93 req-1738cb2c-4bba-48fa-bb3b-b1f44a2f7fff service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-4644c6c1-26f5-46e9-a673-8a68779a0d93 req-1738cb2c-4bba-48fa-bb3b-b1f44a2f7fff service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing instance network info cache due to event network-changed-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4644c6c1-26f5-46e9-a673-8a68779a0d93 req-1738cb2c-4bba-48fa-bb3b-b1f44a2f7fff service nova] Acquiring lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4644c6c1-26f5-46e9-a673-8a68779a0d93 req-1738cb2c-4bba-48fa-bb3b-b1f44a2f7fff service nova] Acquired lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-4644c6c1-26f5-46e9-a673-8a68779a0d93 req-1738cb2c-4bba-48fa-bb3b-b1f44a2f7fff service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Refreshing network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-4644c6c1-26f5-46e9-a673-8a68779a0d93 req-1738cb2c-4bba-48fa-bb3b-b1f44a2f7fff service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updated VIF entry in instance network info cache for port c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG nova.network.neutron [req-4644c6c1-26f5-46e9-a673-8a68779a0d93 req-1738cb2c-4bba-48fa-bb3b-b1f44a2f7fff service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [{"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:12:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4644c6c1-26f5-46e9-a673-8a68779a0d93 req-1738cb2c-4bba-48fa-bb3b-b1f44a2f7fff service nova] Releasing lock "refresh_cache-8a12810b-951d-49dd-b806-7f8f5450b0b5" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9ae901da-c156-4400-bb96-663bed3f81b6 req-4d34d637-bb5a-4579-9ce0-64255ea48c98 service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received event network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9ae901da-c156-4400-bb96-663bed3f81b6 req-4d34d637-bb5a-4579-9ce0-64255ea48c98 service nova] Acquiring lock "6d835111-787d-4968-b8a6-f1584a857cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9ae901da-c156-4400-bb96-663bed3f81b6 req-4d34d637-bb5a-4579-9ce0-64255ea48c98 service nova] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9ae901da-c156-4400-bb96-663bed3f81b6 req-4d34d637-bb5a-4579-9ce0-64255ea48c98 service nova] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-9ae901da-c156-4400-bb96-663bed3f81b6 req-4d34d637-bb5a-4579-9ce0-64255ea48c98 service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] No waiting events found dispatching network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:12:52 user nova-compute[75288]: WARNING nova.compute.manager [req-9ae901da-c156-4400-bb96-663bed3f81b6 req-4d34d637-bb5a-4579-9ce0-64255ea48c98 service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received unexpected event network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad for instance with vm_state building and task_state spawning.
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:12:52 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Instance spawned successfully.
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:12:52 user nova-compute[75288]: INFO nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Took 5.38 seconds to spawn the instance on the hypervisor.
Dec 01 14:12:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:12:52 user nova-compute[75288]: INFO nova.compute.manager [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Took 6.03 seconds to build instance.
Dec 01 14:12:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-5e2b0e8f-19e7-4096-8ff3-bdd6637c40dd tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "6d835111-787d-4968-b8a6-f1584a857cad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.149s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:12:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:12:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:12:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:12:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:12:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:12:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:08 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:08 user nova-compute[75288]: INFO nova.compute.manager [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Detaching volume b1e7ad6f-7acd-49ef-9f8b-133eaefaa986
Dec 01 14:13:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:08 user nova-compute[75288]: INFO nova.virt.block_device [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Attempting to driver detach volume b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 from mountpoint /dev/vdb
Dec 01 14:13:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Attempting to detach device vdb from instance 29b2c407-8c8b-4722-8eec-b1dff1659960 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:13:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:13:08 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:13:08 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:13:08 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:13:08 user nova-compute[75288]:   <serial>b1e7ad6f-7acd-49ef-9f8b-133eaefaa986</serial>
Dec 01 14:13:08 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:13:08 user nova-compute[75288]: </disk>
Dec 01 14:13:08 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:13:08 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully detached device vdb from instance 29b2c407-8c8b-4722-8eec-b1dff1659960 from the persistent domain config.
Dec 01 14:13:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 29b2c407-8c8b-4722-8eec-b1dff1659960 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:13:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:13:08 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:13:08 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:13:08 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:13:08 user nova-compute[75288]:   <serial>b1e7ad6f-7acd-49ef-9f8b-133eaefaa986</serial>
Dec 01 14:13:08 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:13:08 user nova-compute[75288]: </disk>
Dec 01 14:13:08 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:13:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:08 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 29b2c407-8c8b-4722-8eec-b1dff1659960 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:13:10 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 is timed out.
Dec 01 14:13:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully detached device vdb from instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 from the live domain config.
Dec 01 14:13:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNDEORHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:13:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f870511f-56fe-45f0-a469-96d07336ea90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:13:10 user nova-compute[75288]: No targets found.
Dec 01 14:13:10 user nova-compute[75288]: iSNS:
Dec 01 14:13:10 user nova-compute[75288]: No targets found.
Dec 01 14:13:10 user nova-compute[75288]: STATIC:
Dec 01 14:13:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d
Dec 01 14:13:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:13:10 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:13:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986
Dec 01 14:13:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:13:10 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:13:10 user nova-compute[75288]: FIRMWARE:
Dec 01 14:13:10 user nova-compute[75288]: No targets found.
Dec 01 14:13:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:13:10 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:13:10 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e70e55-d317-4772-a16f-304960a60a57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1986d5-b69f-4554-815a-970db3cea711]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:13:10 user nova-compute[75288]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)
Dec 01 14:13:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:13:10 user nova-compute[75288]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d (non-flash)
Dec 01 14:13:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc66d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d8d6d4-94b0-4d4b-9588-f0b37cbbd497]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[066bf69f-99ca-422a-811b-ca633ebcdb07]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d970ab3a-3b17-469a-aa75-9239afe791e8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a425ff-8824-4707-9e7b-4f5ac1072ab4]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[336d5b13-96f5-4cc0-bc0c-2ee55dcf169d]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdba762-b402-4b26-a5a3-b94323efc891]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260]
Dec 01 14:13:10 user nova-compute[75288]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d, portal: 172.16.0.220,3260] successful.
Dec 01 14:13:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:755d7f12-a2e8-488a-a97d-bd63e630a84d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc4e3b6-1f07-4a2f-bcda-208177cad112]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] <== disconnect_volume: return (299ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:13:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:13:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'flavor' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:13:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd06fbb8-eef4-4b1b-b720-0a75c03fb9f3 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.959s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b61fbdc-dc89-4aa1-b79e-20b1e24d390e req-6143629b-1d1e-45b6-8c7f-0c2ca8d9d27e service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received event network-changed-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:13:22 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b61fbdc-dc89-4aa1-b79e-20b1e24d390e req-6143629b-1d1e-45b6-8c7f-0c2ca8d9d27e service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Refreshing instance network info cache due to event network-changed-3f4fdb8d-aaca-4d48-912b-63b5e79671e7. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:13:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b61fbdc-dc89-4aa1-b79e-20b1e24d390e req-6143629b-1d1e-45b6-8c7f-0c2ca8d9d27e service nova] Acquiring lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:13:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b61fbdc-dc89-4aa1-b79e-20b1e24d390e req-6143629b-1d1e-45b6-8c7f-0c2ca8d9d27e service nova] Acquired lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:13:22 user nova-compute[75288]: DEBUG nova.network.neutron [req-3b61fbdc-dc89-4aa1-b79e-20b1e24d390e req-6143629b-1d1e-45b6-8c7f-0c2ca8d9d27e service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Refreshing network info cache for port 3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:13:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-3b61fbdc-dc89-4aa1-b79e-20b1e24d390e req-6143629b-1d1e-45b6-8c7f-0c2ca8d9d27e service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updated VIF entry in instance network info cache for port 3f4fdb8d-aaca-4d48-912b-63b5e79671e7. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:13:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-3b61fbdc-dc89-4aa1-b79e-20b1e24d390e req-6143629b-1d1e-45b6-8c7f-0c2ca8d9d27e service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updating instance_info_cache with network_info: [{"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:13:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b61fbdc-dc89-4aa1-b79e-20b1e24d390e req-6143629b-1d1e-45b6-8c7f-0c2ca8d9d27e service nova] Releasing lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:13:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:25 user nova-compute[75288]: INFO nova.compute.manager [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Attaching volume 47da9f73-4963-4759-a710-5c087284ded5 to /dev/vdb
Dec 01 14:13:25 user nova-compute[75288]: DEBUG os_brick.utils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37a981e-6cd4-42d6-81cb-c56463235960]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6db7b7a-ec1f-4044-8763-d21e2c99bf1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642b677-e959-48da-897c-6a2f07d74d56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1d53a8-dbae-475c-89e1-838ff9f40a44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:13:25 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:13:25 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[150ea56b-d819-4c6d-aa8c-0865800cdd70]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG os_brick.utils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:13:25 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updating existing volume attachment record: ee1d830f-dce0-475b-9522-0ed30b6bd8a9 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:13:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8565MB free_disk=24.952880859375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 29b2c407-8c8b-4722-8eec-b1dff1659960 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 8a12810b-951d-49dd-b806-7f8f5450b0b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 48339b96-a50f-46d0-87d0-078ff6aab9fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 6d835111-787d-4968-b8a6-f1584a857cad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:13:28 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 29b2c407-8c8b-4722-8eec-b1dff1659960 is timed out.
Dec 01 14:13:28 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully detached device vdb from instance 29b2c407-8c8b-4722-8eec-b1dff1659960 from the live domain config.
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoVfgQYT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:13:28 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff24e7-c781-42c6-af85-5c5bfc826857]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:13:28 user nova-compute[75288]: No targets found.
Dec 01 14:13:28 user nova-compute[75288]: iSNS:
Dec 01 14:13:28 user nova-compute[75288]: No targets found.
Dec 01 14:13:28 user nova-compute[75288]: STATIC:
Dec 01 14:13:28 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986
Dec 01 14:13:28 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:13:28 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:13:28 user nova-compute[75288]: FIRMWARE:
Dec 01 14:13:28 user nova-compute[75288]: No targets found.
Dec 01 14:13:28 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:13:28 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:13:28 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[517190a4-7faf-417e-a8b5-a2710aec25d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3f798f-e62d-4a1b-b0dc-63d901b10c3b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:13:28 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 (non-flash)
Dec 01 14:13:28 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbdc220790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a32502-59ef-4af9-aac9-b1da4cc6826f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c552315-941e-43d3-9c9f-4e4fee498976]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed69557-e988-49f0-b922-a96dcd4b4f4c]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ee8820-3d73-46fb-8753-1fefecf36737]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc33185a-8170-4a32-bf1a-357d60f8c983]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cdb6b6-e500-490a-b7ca-278216f6e0fa]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986, portal: 172.16.0.220,3260]
Dec 01 14:13:28 user nova-compute[75288]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986, portal: 172.16.0.220,3260] successful.
Dec 01 14:13:28 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1e7ad6f-7acd-49ef-9f8b-133eaefaa986 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d71ba-cef3-4864-a0f6-96ffddfe9ead]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== disconnect_volume: return (323ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:13:28 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:13:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid 29b2c407-8c8b-4722-8eec-b1dff1659960 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-28ef6f4b-ce93-42d9-9e9b-fb4f916fad76 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.984s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzkliLJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:13:38 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:13:38 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:13:38 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e436bf5-22d6-49d3-8356-e0b1c2ee1a91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:13:38 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc95b30-b509-4ba1-8380-dfd60a2ff624]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5] added
Dec 01 14:13:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc138e-3c5a-424e-9300-c718ac21d100]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16171b5-5efb-4d85-8990-a0c2aacbcb31]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzkliLJU {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dzkliLJU" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47493f7-fffd-46af-9ce0-32f5459903a2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dzkliLJU'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56f4ebb-eb1d-4600-92dc-e57bf0643274]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[42924c31-e2d4-4b74-928b-af281c9ee545]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:13:38 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:13:38 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:13:38 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 14:13:38 user nova-compute[75288]: 
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b40f2-fff0-4229-a7e8-e9143043166f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5, portal: 172.16.0.220,3260]
Dec 01 14:13:38 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5, portal: 172.16.0.220,3260] successful.
Dec 01 14:13:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe974dad-5494-441e-8659-e0bd366aa9cf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a93aa77-16e8-4136-92aa-fa0433d41c42]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)
Dec 01 14:13:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)
Dec 01 14:13:38 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f762e4e5-597b-422a-9192-0050c6c83c19]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzkliLJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:13:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:13:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23665323866646363', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:13:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665323866646363', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:13:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:13:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:13:39 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:13:39 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:13:39 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:13:39 user nova-compute[75288]:   <serial>47da9f73-4963-4759-a710-5c087284ded5</serial>
Dec 01 14:13:39 user nova-compute[75288]: </disk>
Dec 01 14:13:39 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:13:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:13:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:13:39 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No VIF found with MAC fa:16:3e:6e:19:31, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:13:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-4cfdb334-fb56-47fb-baf1-cbbdd663261e tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.291s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:13:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:13:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:13:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:13:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:44 user nova-compute[75288]: INFO nova.compute.manager [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Terminating instance
Dec 01 14:13:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-cbd7643f-24f2-4c78-a7e6-c23f82f009d3 req-6614c4f6-352f-4ec0-86f8-757f433f3be9 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-unplugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cbd7643f-24f2-4c78-a7e6-c23f82f009d3 req-6614c4f6-352f-4ec0-86f8-757f433f3be9 service nova] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cbd7643f-24f2-4c78-a7e6-c23f82f009d3 req-6614c4f6-352f-4ec0-86f8-757f433f3be9 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-cbd7643f-24f2-4c78-a7e6-c23f82f009d3 req-6614c4f6-352f-4ec0-86f8-757f433f3be9 service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-cbd7643f-24f2-4c78-a7e6-c23f82f009d3 req-6614c4f6-352f-4ec0-86f8-757f433f3be9 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] No waiting events found dispatching network-vif-unplugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-cbd7643f-24f2-4c78-a7e6-c23f82f009d3 req-6614c4f6-352f-4ec0-86f8-757f433f3be9 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-unplugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:13:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Instance destroyed successfully.
Dec 01 14:13:44 user nova-compute[75288]: DEBUG nova.objects.instance [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'resources' on Instance uuid 8a12810b-951d-49dd-b806-7f8f5450b0b5 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2033342625',display_name='tempest-TestMinimumBasicScenario-server-2033342625',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2033342625',id=43,image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZR3GgEecmQd7suZ3Kuut7N5ZxRLtI7Epo/GolBsiosWZo+Z9jbNd/c2h/duv0WBExWj89HIOK1LbzjT6wNgKTBFwea/O7UnGbNmUIJNTXGMImJwVi6pE35H9+2eZMu9w==',key_name='tempest-TestMinimumBasicScenario-1390302078',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:08:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ewu3008a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72279a56-d0d4-45ec-81b3-58c4f3232bbb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:11:04Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=8a12810b-951d-49dd-b806-7f8f5450b0b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "address": "fa:16:3e:a7:02:3e", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ca0ba9-dc", "ovs_interfaceid": "c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG os_vif [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5ca0ba9-dc, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb1bef98-a759-4e37-b465-c0e2149b2193) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:44 user nova-compute[75288]: INFO os_vif [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:02:3e,bridge_name='br-int',has_traffic_filtering=True,id=c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ca0ba9-dc')
Dec 01 14:13:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Deleting instance files /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5_del
Dec 01 14:13:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Deletion of /opt/stack/data/nova/instances/8a12810b-951d-49dd-b806-7f8f5450b0b5_del complete
Dec 01 14:13:45 user nova-compute[75288]: INFO nova.compute.manager [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:13:45 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Took 0.58 seconds to deallocate network for instance.
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-8406c472-9f85-41a1-9be2-b90084876e41 req-ed2bdf9c-75dc-4049-a93e-08e1043a1225 service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-deleted-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:45 user nova-compute[75288]: INFO nova.compute.manager [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Attaching volume c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c to /dev/vdc
Dec 01 14:13:45 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:13:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:45 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Deleted allocations for instance 8a12810b-951d-49dd-b806-7f8f5450b0b5
Dec 01 14:13:46 user nova-compute[75288]: DEBUG os_brick.utils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c567c0f0-f62b-49cd-9baa-20afeb5b435a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[578765be-23d1-4cad-a4b9-be97da60534b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e9ef55-2bfc-419b-9231-b67f57d35ccd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-2883d166-9a32-4153-998f-1d7e1b1d2419 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.946s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b49d52-6ce4-4934-bc0b-70cdfb35c396]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:13:46 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c404707-4e3a-47c6-afe6-6cfd8f9a81c1]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG os_brick.utils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updating existing volume attachment record: 796521a9-0d74-4fae-ab28-3d6beba866fa {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-591da019-942b-44d0-a027-edc7effe2338 req-3af0a120-0261-4531-81d2-3e42c75f2e1f service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-591da019-942b-44d0-a027-edc7effe2338 req-3af0a120-0261-4531-81d2-3e42c75f2e1f service nova] Acquiring lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-591da019-942b-44d0-a027-edc7effe2338 req-3af0a120-0261-4531-81d2-3e42c75f2e1f service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-591da019-942b-44d0-a027-edc7effe2338 req-3af0a120-0261-4531-81d2-3e42c75f2e1f service nova] Lock "8a12810b-951d-49dd-b806-7f8f5450b0b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-591da019-942b-44d0-a027-edc7effe2338 req-3af0a120-0261-4531-81d2-3e42c75f2e1f service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] No waiting events found dispatching network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:13:46 user nova-compute[75288]: WARNING nova.compute.manager [req-591da019-942b-44d0-a027-edc7effe2338 req-3af0a120-0261-4531-81d2-3e42c75f2e1f service nova] [instance: 8a12810b-951d-49dd-b806-7f8f5450b0b5] Received unexpected event network-vif-plugged-c5ca0ba9-dc71-4170-a05c-33e7a9b1f3fa for instance with vm_state deleted and task_state None.
Dec 01 14:13:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWzijvcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:13:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:13:54 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:13:54 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2529437-b091-40b2-bb57-a1cd1d3f817f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:13:54 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[603388a5-2395-4a61-a982-fc3d7db2b228]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c] added
Dec 01 14:13:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[22583b96-04ac-43d5-a22f-cc086ea3445b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99925f8-1ed9-4a37-b55b-52e4263acc32]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWzijvcF {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWzijvcF" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[759f9ccd-2378-4522-a0fe-9fd81dffac30]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWzijvcF'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9466206-7a60-4577-9479-25c1a412ca70]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[608195fc-1b6d-4e2b-84e5-55641f1efad0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)
Dec 01 14:13:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)
Dec 01 14:13:54 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:13:54 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da75895-c29c-4335-8381-9febd6451f1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c, portal: 172.16.0.220,3260]
Dec 01 14:13:55 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c, portal: 172.16.0.220,3260] successful.
Dec 01 14:13:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedbd33e-ecc6-4839-922c-1106a18d2a3b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1207f14-fdd9-44bd-8b5a-fb66326cc3cc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)
Dec 01 14:13:55 user nova-compute[75288]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)
Dec 01 14:13:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)
Dec 01 14:13:55 user nova-compute[75288]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)
Dec 01 14:13:55 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cf70c3-eaa5-46ed-939c-da7a1d686a0e]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:13:55 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWzijvcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23930646136396338', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930646136396338', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG nova.objects.instance [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:13:56 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:13:56 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:13:56 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Dec 01 14:13:56 user nova-compute[75288]:   <serial>c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c</serial>
Dec 01 14:13:56 user nova-compute[75288]: </disk>
Dec 01 14:13:56 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] No VIF found with MAC fa:16:3e:6e:19:31, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:13:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-32db3ab5-fcc0-465b-9144-b473cde7f006 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.878s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:58 user nova-compute[75288]: INFO nova.compute.manager [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Detaching volume 47da9f73-4963-4759-a710-5c087284ded5
Dec 01 14:13:58 user nova-compute[75288]: INFO nova.virt.block_device [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Attempting to driver detach volume 47da9f73-4963-4759-a710-5c087284ded5 from mountpoint /dev/vdb
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Attempting to detach device vdb from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:13:58 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:13:58 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:13:58 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:13:58 user nova-compute[75288]:   <serial>47da9f73-4963-4759-a710-5c087284ded5</serial>
Dec 01 14:13:58 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:13:58 user nova-compute[75288]: </disk>
Dec 01 14:13:58 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:13:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully detached device vdb from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa from the persistent domain config.
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:13:58 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:13:58 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:13:58 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:13:58 user nova-compute[75288]:   <serial>47da9f73-4963-4759-a710-5c087284ded5</serial>
Dec 01 14:13:58 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:13:58 user nova-compute[75288]: </disk>
Dec 01 14:13:58 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:58 user nova-compute[75288]: INFO nova.compute.manager [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Terminating instance
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f1a0a71-0f4c-4cbd-91d4-e244aa882a84 req-895c2477-fa8e-4ef7-af5d-c7005d7ce40f service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received event network-vif-unplugged-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f1a0a71-0f4c-4cbd-91d4-e244aa882a84 req-895c2477-fa8e-4ef7-af5d-c7005d7ce40f service nova] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f1a0a71-0f4c-4cbd-91d4-e244aa882a84 req-895c2477-fa8e-4ef7-af5d-c7005d7ce40f service nova] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7f1a0a71-0f4c-4cbd-91d4-e244aa882a84 req-895c2477-fa8e-4ef7-af5d-c7005d7ce40f service nova] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f1a0a71-0f4c-4cbd-91d4-e244aa882a84 req-895c2477-fa8e-4ef7-af5d-c7005d7ce40f service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] No waiting events found dispatching network-vif-unplugged-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-7f1a0a71-0f4c-4cbd-91d4-e244aa882a84 req-895c2477-fa8e-4ef7-af5d-c7005d7ce40f service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received event network-vif-unplugged-cd6e5ca0-8656-4f7d-8679-931e3418984a for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:13:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Instance destroyed successfully.
Dec 01 14:13:59 user nova-compute[75288]: DEBUG nova.objects.instance [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'resources' on Instance uuid 29b2c407-8c8b-4722-8eec-b1dff1659960 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-827723600',display_name='tempest-AttachVolumeNegativeTest-server-827723600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-827723600',id=42,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUkfsQX/m2vqtog4yk2lBhrNjh3tMjH67G2tUnJvLnYPyhZo5rEl9c8ImEX//MZt1WiRcgwtWgyMYJw6SJndVkeNNYhIv4RdTF+SaYEGeHWpDncu6EHtv+zxp4KOxke2A==',key_name='tempest-keypair-1865117686',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:08:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-jvsuzue8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=29b2c407-8c8b-4722-8eec-b1dff1659960,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "address": "fa:16:3e:fd:0e:ac", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd6e5ca0-86", "ovs_interfaceid": "cd6e5ca0-8656-4f7d-8679-931e3418984a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:0e:ac,bridge_name='br-int',has_traffic_filtering=True,id=cd6e5ca0-8656-4f7d-8679-931e3418984a,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6e5ca0-86') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG os_vif [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:0e:ac,bridge_name='br-int',has_traffic_filtering=True,id=cd6e5ca0-8656-4f7d-8679-931e3418984a,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6e5ca0-86') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd6e5ca0-86, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=408cd298-412d-4999-a999-87425bcea1ff) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:13:59 user nova-compute[75288]: INFO os_vif [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:0e:ac,bridge_name='br-int',has_traffic_filtering=True,id=cd6e5ca0-8656-4f7d-8679-931e3418984a,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd6e5ca0-86')
Dec 01 14:13:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Deleting instance files /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960_del
Dec 01 14:13:59 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Deletion of /opt/stack/data/nova/instances/29b2c407-8c8b-4722-8eec-b1dff1659960_del complete
Dec 01 14:13:59 user nova-compute[75288]: INFO nova.compute.manager [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 01 14:13:59 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:13:59 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:13:59 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Took 0.81 seconds to deallocate network for instance.
Dec 01 14:14:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-00e770e3-5f47-4246-9dd7-a988678a69d9 req-8b12231c-9f47-4edd-95c9-9879a3d443da service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received event network-vif-deleted-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:00 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Deleted allocations for instance 29b2c407-8c8b-4722-8eec-b1dff1659960
Dec 01 14:14:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-da3bbbb8-d1d5-4a58-b63e-8eeaec12647e tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.993s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-37a6485f-9556-43cb-b007-1e8e633602ab req-fcd83234-dcc3-44e4-a7df-3cf3eb63a8df service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received event network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37a6485f-9556-43cb-b007-1e8e633602ab req-fcd83234-dcc3-44e4-a7df-3cf3eb63a8df service nova] Acquiring lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37a6485f-9556-43cb-b007-1e8e633602ab req-fcd83234-dcc3-44e4-a7df-3cf3eb63a8df service nova] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-37a6485f-9556-43cb-b007-1e8e633602ab req-fcd83234-dcc3-44e4-a7df-3cf3eb63a8df service nova] Lock "29b2c407-8c8b-4722-8eec-b1dff1659960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-37a6485f-9556-43cb-b007-1e8e633602ab req-fcd83234-dcc3-44e4-a7df-3cf3eb63a8df service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] No waiting events found dispatching network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:00 user nova-compute[75288]: WARNING nova.compute.manager [req-37a6485f-9556-43cb-b007-1e8e633602ab req-fcd83234-dcc3-44e4-a7df-3cf3eb63a8df service nova] [instance: 29b2c407-8c8b-4722-8eec-b1dff1659960] Received unexpected event network-vif-plugged-cd6e5ca0-8656-4f7d-8679-931e3418984a for instance with vm_state deleted and task_state None.
Dec 01 14:14:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:16 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:18 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa is timed out.
Dec 01 14:14:18 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully detached device vdb from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa from the live domain config.
Dec 01 14:14:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dzkliLJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:14:18 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c66b88-366c-4a77-954d-f0a0703448e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:14:18 user nova-compute[75288]: No targets found.
Dec 01 14:14:18 user nova-compute[75288]: iSNS:
Dec 01 14:14:18 user nova-compute[75288]: No targets found.
Dec 01 14:14:18 user nova-compute[75288]: STATIC:
Dec 01 14:14:18 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5
Dec 01 14:14:18 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:14:18 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:14:18 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c
Dec 01 14:14:18 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:14:18 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:14:18 user nova-compute[75288]: FIRMWARE:
Dec 01 14:14:18 user nova-compute[75288]: No targets found.
Dec 01 14:14:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:14:18 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:14:18 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[46957476-10b4-4ddb-bba6-aa32ca7c3ce9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc9c321-d10a-4bd1-8f84-92252d2c7e8c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)
Dec 01 14:14:18 user nova-compute[75288]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)
Dec 01 14:14:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 (non-flash)
Dec 01 14:14:18 user nova-compute[75288]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)
Dec 01 14:14:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98e8ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d91480-c39a-473c-8c70-5f446fc57fbf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb1acc-eeb0-4b6f-88ce-837da2357fb9]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51d91f2-6724-4a25-88bb-a77b126aadd6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[73977312-6f8c-41fd-9cc6-f1224e0d6f5e]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d7f444-f026-405c-b66b-d8c10a972684]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2576fb-efad-4c93-ac36-2527b77860e6]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5, portal: 172.16.0.220,3260]
Dec 01 14:14:18 user nova-compute[75288]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5, portal: 172.16.0.220,3260] successful.
Dec 01 14:14:18 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47da9f73-4963-4759-a710-5c087284ded5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69f6257-dea1-4f30-91f4-46c4bdeb2cb7]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== disconnect_volume: return (280ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:14:18 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:14:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:19 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:14:19 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1fad3e13-554a-4eb7-8ed9-aef3e742ca75 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.843s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:20 user nova-compute[75288]: INFO nova.compute.manager [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Detaching volume c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c
Dec 01 14:14:20 user nova-compute[75288]: INFO nova.virt.block_device [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Attempting to driver detach volume c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c from mountpoint /dev/vdc
Dec 01 14:14:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Attempting to detach device vdc from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:14:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:14:20 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:14:20 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:14:20 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Dec 01 14:14:20 user nova-compute[75288]:   <serial>c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c</serial>
Dec 01 14:14:20 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 14:14:20 user nova-compute[75288]: </disk>
Dec 01 14:14:20 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:14:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully detached device vdc from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa from the persistent domain config.
Dec 01 14:14:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:14:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:14:20 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:14:20 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:14:20 user nova-compute[75288]:   <target dev="vdc" bus="virtio"/>
Dec 01 14:14:20 user nova-compute[75288]:   <serial>c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c</serial>
Dec 01 14:14:20 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 14:14:20 user nova-compute[75288]: </disk>
Dec 01 14:14:20 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:14:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:14:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:14:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:14:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8710MB free_disk=25.007095336914062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 48339b96-a50f-46d0-87d0-078ff6aab9fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 6d835111-787d-4968-b8a6-f1584a857cad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:14:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:14:28 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updating instance_info_cache with network_info: [{"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-48339b96-a50f-46d0-87d0-078ff6aab9fa" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:29 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 14:14:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "6d835111-787d-4968-b8a6-f1584a857cad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "6d835111-787d-4968-b8a6-f1584a857cad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "6d835111-787d-4968-b8a6-f1584a857cad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:36 user nova-compute[75288]: INFO nova.compute.manager [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Terminating instance
Dec 01 14:14:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:14:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-132f2031-b01f-4d03-8a69-022798745ba3 req-9e991ddb-ef35-4381-a2ff-edade7e8d7da service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received event network-vif-unplugged-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-132f2031-b01f-4d03-8a69-022798745ba3 req-9e991ddb-ef35-4381-a2ff-edade7e8d7da service nova] Acquiring lock "6d835111-787d-4968-b8a6-f1584a857cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-132f2031-b01f-4d03-8a69-022798745ba3 req-9e991ddb-ef35-4381-a2ff-edade7e8d7da service nova] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-132f2031-b01f-4d03-8a69-022798745ba3 req-9e991ddb-ef35-4381-a2ff-edade7e8d7da service nova] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-132f2031-b01f-4d03-8a69-022798745ba3 req-9e991ddb-ef35-4381-a2ff-edade7e8d7da service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] No waiting events found dispatching network-vif-unplugged-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.compute.manager [req-132f2031-b01f-4d03-8a69-022798745ba3 req-9e991ddb-ef35-4381-a2ff-edade7e8d7da service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received event network-vif-unplugged-4c90cba1-3038-4f63-b6b5-c94f597037ad for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Instance destroyed successfully.
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.objects.instance [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lazy-loading 'resources' on Instance uuid 6d835111-787d-4968-b8a6-f1584a857cad {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1406921414',display_name='tempest-VolumesActionsTest-instance-1406921414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1406921414',id=47,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c81faa0ffc4f8881312e037ca7ac3a',ramdisk_id='',reservation_id='r-l09lwklx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1772844408',owner_user_name='tempest-VolumesActionsTest-1772844408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:12:52Z,user_data=None,user_id='e0c1c4feb6d448ffa4032d725206e293',uuid=6d835111-787d-4968-b8a6-f1584a857cad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converting VIF {"id": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "address": "fa:16:3e:b7:6b:78", "network": {"id": "34f8aa40-6cac-4cca-99b6-75bd1a98be53", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1147857389-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c81faa0ffc4f8881312e037ca7ac3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90cba1-30", "ovs_interfaceid": "4c90cba1-3038-4f63-b6b5-c94f597037ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:6b:78,bridge_name='br-int',has_traffic_filtering=True,id=4c90cba1-3038-4f63-b6b5-c94f597037ad,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90cba1-30') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG os_vif [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:6b:78,bridge_name='br-int',has_traffic_filtering=True,id=4c90cba1-3038-4f63-b6b5-c94f597037ad,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90cba1-30') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c90cba1-30, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=358393c1-5a8b-46d6-8af1-001d7b8c4641) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:37 user nova-compute[75288]: INFO os_vif [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:6b:78,bridge_name='br-int',has_traffic_filtering=True,id=4c90cba1-3038-4f63-b6b5-c94f597037ad,network=Network(34f8aa40-6cac-4cca-99b6-75bd1a98be53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90cba1-30')
Dec 01 14:14:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Deleting instance files /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad_del
Dec 01 14:14:37 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Deletion of /opt/stack/data/nova/instances/6d835111-787d-4968-b8a6-f1584a857cad_del complete
Dec 01 14:14:37 user nova-compute[75288]: INFO nova.compute.manager [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Took 0.66 seconds to destroy the instance on the hypervisor.
Dec 01 14:14:37 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:14:37 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:14:38 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Took 0.59 seconds to deallocate network for instance.
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.154s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:14:38 user nova-compute[75288]: INFO nova.compute.claims [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Claim successful on node user
Dec 01 14:14:38 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Deleted allocations for instance 6d835111-787d-4968-b8a6-f1584a857cad
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-1cdb8359-411b-4a2b-b032-ecffe6bf682e tempest-VolumesActionsTest-1772844408 tempest-VolumesActionsTest-1772844408-project-member] Lock "6d835111-787d-4968-b8a6-f1584a857cad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.596s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:14:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.policy [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02f74cb0fb13418b894e8517317bea9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fae7777bb784a55b159c88bc38e4fe9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:14:38 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Creating image(s)
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "/opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "/opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "/opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be.part --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-87095fd3-4d6c-4540-96eb-7ea69ed866f7 req-cc79bd1c-a2b3-47eb-87f3-cd010581728e service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received event network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-87095fd3-4d6c-4540-96eb-7ea69ed866f7 req-cc79bd1c-a2b3-47eb-87f3-cd010581728e service nova] Acquiring lock "6d835111-787d-4968-b8a6-f1584a857cad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-87095fd3-4d6c-4540-96eb-7ea69ed866f7 req-cc79bd1c-a2b3-47eb-87f3-cd010581728e service nova] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-87095fd3-4d6c-4540-96eb-7ea69ed866f7 req-cc79bd1c-a2b3-47eb-87f3-cd010581728e service nova] Lock "6d835111-787d-4968-b8a6-f1584a857cad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-87095fd3-4d6c-4540-96eb-7ea69ed866f7 req-cc79bd1c-a2b3-47eb-87f3-cd010581728e service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] No waiting events found dispatching network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:39 user nova-compute[75288]: WARNING nova.compute.manager [req-87095fd3-4d6c-4540-96eb-7ea69ed866f7 req-cc79bd1c-a2b3-47eb-87f3-cd010581728e service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received unexpected event network-vif-plugged-4c90cba1-3038-4f63-b6b5-c94f597037ad for instance with vm_state deleted and task_state None.
Dec 01 14:14:39 user nova-compute[75288]: DEBUG nova.compute.manager [req-87095fd3-4d6c-4540-96eb-7ea69ed866f7 req-cc79bd1c-a2b3-47eb-87f3-cd010581728e service nova] [instance: 6d835111-787d-4968-b8a6-f1584a857cad] Received event network-vif-deleted-4c90cba1-3038-4f63-b6b5-c94f597037ad {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Successfully created port: 01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG nova.virt.images [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] e1295c1f-d1d8-43db-8aef-8b1c40374767 was qcow2, converting to raw {{(pid=75288) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG nova.privsep.utils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75288) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be.part /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be.converted {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be.part /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be.converted" returned: 0 in 0.170s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be.converted --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.950s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG nova.network.neutron [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Successfully updated port: 01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:14:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be --force-share --output=json" returned: 0 in 0.183s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be,backing_fmt=raw /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be,backing_fmt=raw /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk 1073741824" returned: 0 in 0.046s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be --force-share --output=json" returned: 0 in 0.167s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.network.neutron [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Instance network_info: |[{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Cannot resize image /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Ensure instance console log exists: /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Start _get_guest_xml network_info=[{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T14:14:35Z,direct_url=<?>,disk_format='qcow2',id=e1295c1f-d1d8-43db-8aef-8b1c40374767,min_disk=0,min_ram=0,name='tempest-scenario-img--1225696887',owner='5fae7777bb784a55b159c88bc38e4fe9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T14:14:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': 'e1295c1f-d1d8-43db-8aef-8b1c40374767'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:14:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:14:40 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T14:14:35Z,direct_url=<?>,disk_format='qcow2',id=e1295c1f-d1d8-43db-8aef-8b1c40374767,min_disk=0,min_ram=0,name='tempest-scenario-img--1225696887',owner='5fae7777bb784a55b159c88bc38e4fe9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T14:14:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1101455580',display_name='tempest-TestMinimumBasicScenario-server-1101455580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1101455580',id=48,image_ref='e1295c1f-d1d8-43db-8aef-8b1c40374767',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMahwg2uxin1r1kx6Jp6FwHMonLCVKjiu4AlqIGxsy+2i7EHT1MTlMIUuWsEe8POfwDA33q1JrUMqzg6U/P2AF+TaeODv+2jMcmlAxl1bu4zUsI07Fegr3f95Wd9thDTjw==',key_name='tempest-TestMinimumBasicScenario-480209938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ah77t449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1295c1f-d1d8-43db-8aef-8b1c40374767',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:14:39Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=42eb4684-79a0-4ff3-92b4-e364a39b96b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=01aa5dda-3f60-49b5-aaca-418833fea664,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa5dda-3f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.objects.instance [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'pci_devices' on Instance uuid 42eb4684-79a0-4ff3-92b4-e364a39b96b7 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:14:40 user nova-compute[75288]:   <uuid>42eb4684-79a0-4ff3-92b4-e364a39b96b7</uuid>
Dec 01 14:14:40 user nova-compute[75288]:   <name>instance-00000030</name>
Dec 01 14:14:40 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:14:40 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:14:40 user nova-compute[75288]:   <metadata>
Dec 01 14:14:40 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:14:40 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:14:40 user nova-compute[75288]:       <nova:name>tempest-TestMinimumBasicScenario-server-1101455580</nova:name>
Dec 01 14:14:40 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:14:40</nova:creationTime>
Dec 01 14:14:40 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:14:40 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:14:40 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:14:40 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:14:40 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:14:40 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:14:40 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:14:40 user nova-compute[75288]:       <nova:owner>
Dec 01 14:14:40 user nova-compute[75288]:         <nova:user uuid="02f74cb0fb13418b894e8517317bea9e">tempest-TestMinimumBasicScenario-652077982-project-member</nova:user>
Dec 01 14:14:40 user nova-compute[75288]:         <nova:project uuid="5fae7777bb784a55b159c88bc38e4fe9">tempest-TestMinimumBasicScenario-652077982</nova:project>
Dec 01 14:14:40 user nova-compute[75288]:       </nova:owner>
Dec 01 14:14:40 user nova-compute[75288]:       <nova:root type="image" uuid="e1295c1f-d1d8-43db-8aef-8b1c40374767"/>
Dec 01 14:14:40 user nova-compute[75288]:       <nova:ports>
Dec 01 14:14:40 user nova-compute[75288]:         <nova:port uuid="01aa5dda-3f60-49b5-aaca-418833fea664">
Dec 01 14:14:40 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 14:14:40 user nova-compute[75288]:         </nova:port>
Dec 01 14:14:40 user nova-compute[75288]:       </nova:ports>
Dec 01 14:14:40 user nova-compute[75288]:     </nova:instance>
Dec 01 14:14:40 user nova-compute[75288]:   </metadata>
Dec 01 14:14:40 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:14:40 user nova-compute[75288]:     <system>
Dec 01 14:14:40 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:14:40 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:14:40 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:14:40 user nova-compute[75288]:       <entry name="serial">42eb4684-79a0-4ff3-92b4-e364a39b96b7</entry>
Dec 01 14:14:40 user nova-compute[75288]:       <entry name="uuid">42eb4684-79a0-4ff3-92b4-e364a39b96b7</entry>
Dec 01 14:14:40 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:14:40 user nova-compute[75288]:     </system>
Dec 01 14:14:40 user nova-compute[75288]:   </sysinfo>
Dec 01 14:14:40 user nova-compute[75288]:   <os>
Dec 01 14:14:40 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:14:40 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:14:40 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:14:40 user nova-compute[75288]:   </os>
Dec 01 14:14:40 user nova-compute[75288]:   <features>
Dec 01 14:14:40 user nova-compute[75288]:     <acpi/>
Dec 01 14:14:40 user nova-compute[75288]:     <apic/>
Dec 01 14:14:40 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:14:40 user nova-compute[75288]:   </features>
Dec 01 14:14:40 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:14:40 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:14:40 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:14:40 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:14:40 user nova-compute[75288]:   </clock>
Dec 01 14:14:40 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:14:40 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:14:40 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:14:40 user nova-compute[75288]:   </cpu>
Dec 01 14:14:40 user nova-compute[75288]:   <devices>
Dec 01 14:14:40 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:14:40 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:14:40 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk"/>
Dec 01 14:14:40 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:14:40 user nova-compute[75288]:     </disk>
Dec 01 14:14:40 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:14:40 user nova-compute[75288]:       <mac address="fa:16:3e:8e:d1:ae"/>
Dec 01 14:14:40 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:14:40 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:14:40 user nova-compute[75288]:       <target dev="tap01aa5dda-3f"/>
Dec 01 14:14:40 user nova-compute[75288]:     </interface>
Dec 01 14:14:40 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:14:40 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/console.log" append="off"/>
Dec 01 14:14:40 user nova-compute[75288]:     </serial>
Dec 01 14:14:40 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:14:40 user nova-compute[75288]:     <video>
Dec 01 14:14:40 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:14:40 user nova-compute[75288]:     </video>
Dec 01 14:14:40 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:14:40 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:14:40 user nova-compute[75288]:     </rng>
Dec 01 14:14:40 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:14:40 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:14:40 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:14:40 user nova-compute[75288]:     </memballoon>
Dec 01 14:14:40 user nova-compute[75288]:   </devices>
Dec 01 14:14:40 user nova-compute[75288]: </domain>
Dec 01 14:14:40 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1101455580',display_name='tempest-TestMinimumBasicScenario-server-1101455580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1101455580',id=48,image_ref='e1295c1f-d1d8-43db-8aef-8b1c40374767',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMahwg2uxin1r1kx6Jp6FwHMonLCVKjiu4AlqIGxsy+2i7EHT1MTlMIUuWsEe8POfwDA33q1JrUMqzg6U/P2AF+TaeODv+2jMcmlAxl1bu4zUsI07Fegr3f95Wd9thDTjw==',key_name='tempest-TestMinimumBasicScenario-480209938',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ah77t449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1295c1f-d1d8-43db-8aef-8b1c40374767',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:14:39Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=42eb4684-79a0-4ff3-92b4-e364a39b96b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=01aa5dda-3f60-49b5-aaca-418833fea664,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa5dda-3f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG os_vif [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=01aa5dda-3f60-49b5-aaca-418833fea664,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa5dda-3f') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '602dee45-3be2-5045-9e18-bd6c76c06916', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01aa5dda-3f, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01aa5dda-3f, col_values=(('qos', UUID('bb4500aa-46f8-4452-8122-7c534bc35b1d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01aa5dda-3f, col_values=(('external_ids', {'iface-id': '01aa5dda-3f60-49b5-aaca-418833fea664', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:d1:ae', 'vm-uuid': '42eb4684-79a0-4ff3-92b4-e364a39b96b7'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:40 user nova-compute[75288]: INFO os_vif [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=01aa5dda-3f60-49b5-aaca-418833fea664,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa5dda-3f')
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:14:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No VIF found with MAC fa:16:3e:8e:d1:ae, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-28b4141f-fe1d-4898-9510-d179be919c0e req-d17a0672-5294-4173-8b16-43928486109e service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-28b4141f-fe1d-4898-9510-d179be919c0e req-d17a0672-5294-4173-8b16-43928486109e service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing instance network info cache due to event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28b4141f-fe1d-4898-9510-d179be919c0e req-d17a0672-5294-4173-8b16-43928486109e service nova] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28b4141f-fe1d-4898-9510-d179be919c0e req-d17a0672-5294-4173-8b16-43928486109e service nova] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-28b4141f-fe1d-4898-9510-d179be919c0e req-d17a0672-5294-4173-8b16-43928486109e service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:14:41 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa is timed out.
Dec 01 14:14:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully detached device vdc from instance 48339b96-a50f-46d0-87d0-078ff6aab9fa from the live domain config.
Dec 01 14:14:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWzijvcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:14:41 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a7996e-630c-4e0a-af3b-7a787e1da381]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:14:41 user nova-compute[75288]: No targets found.
Dec 01 14:14:41 user nova-compute[75288]: iSNS:
Dec 01 14:14:41 user nova-compute[75288]: No targets found.
Dec 01 14:14:41 user nova-compute[75288]: STATIC:
Dec 01 14:14:41 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c
Dec 01 14:14:41 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:14:41 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:14:41 user nova-compute[75288]: FIRMWARE:
Dec 01 14:14:41 user nova-compute[75288]: No targets found.
Dec 01 14:14:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:14:41 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:14:41 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[356dda3f-c8a6-467d-b4ba-eb3bf86a5f82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a49091-cc8a-420f-89bd-84106c8d8250]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)
Dec 01 14:14:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c (non-flash)
Dec 01 14:14:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98f14550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2ba47-b361-4297-94b7-2bc65d3dc704]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6645194f-4cdf-441d-8867-5c99f819a918]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bf626e-ef7f-42fb-82d8-b49070ffaebe]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[670fcfab-5fa8-4742-b7ac-92c729d5089b]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f584a25-187c-47d9-b5e3-6d8c0f3dc818]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f7ce7f-0c98-40b7-9cb6-71d00d250168]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c, portal: 172.16.0.220,3260]
Dec 01 14:14:41 user nova-compute[75288]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c, portal: 172.16.0.220,3260] successful.
Dec 01 14:14:41 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3a18d05-1edb-4c00-9e2f-c4bbd9ee7c6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[18872e3d-0a08-442e-a1f9-6be83205347b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] <== disconnect_volume: return (280ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-28b4141f-fe1d-4898-9510-d179be919c0e req-d17a0672-5294-4173-8b16-43928486109e service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updated VIF entry in instance network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG nova.network.neutron [req-28b4141f-fe1d-4898-9510-d179be919c0e req-d17a0672-5294-4173-8b16-43928486109e service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:14:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-28b4141f-fe1d-4898-9510-d179be919c0e req-d17a0672-5294-4173-8b16-43928486109e service nova] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:14:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:42 user nova-compute[75288]: DEBUG nova.objects.instance [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'flavor' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:14:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-6598f2c3-dc58-4390-83d0-ab817e4c2eea tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] No waiting events found dispatching network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:43 user nova-compute[75288]: WARNING nova.compute.manager [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received unexpected event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 for instance with vm_state building and task_state spawning.
Dec 01 14:14:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] No waiting events found dispatching network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:43 user nova-compute[75288]: WARNING nova.compute.manager [req-00e37b98-6828-4605-91fb-8ed379f31f1a req-a79e98c0-aec6-4268-a8b1-4bc799573a80 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received unexpected event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 for instance with vm_state building and task_state spawning.
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:43 user nova-compute[75288]: INFO nova.compute.manager [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Terminating instance
Dec 01 14:14:43 user nova-compute[75288]: DEBUG nova.compute.manager [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-eb90d162-a620-4e92-8488-d46184367638 req-d4a48fbc-1b65-4576-a050-bff841b057b4 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received event network-vif-unplugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eb90d162-a620-4e92-8488-d46184367638 req-d4a48fbc-1b65-4576-a050-bff841b057b4 service nova] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eb90d162-a620-4e92-8488-d46184367638 req-d4a48fbc-1b65-4576-a050-bff841b057b4 service nova] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-eb90d162-a620-4e92-8488-d46184367638 req-d4a48fbc-1b65-4576-a050-bff841b057b4 service nova] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-eb90d162-a620-4e92-8488-d46184367638 req-d4a48fbc-1b65-4576-a050-bff841b057b4 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] No waiting events found dispatching network-vif-unplugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-eb90d162-a620-4e92-8488-d46184367638 req-d4a48fbc-1b65-4576-a050-bff841b057b4 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received event network-vif-unplugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:14:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Instance spawned successfully.
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:44 user nova-compute[75288]: INFO nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Took 5.52 seconds to spawn the instance on the hypervisor.
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Instance destroyed successfully.
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.objects.instance [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lazy-loading 'resources' on Instance uuid 48339b96-a50f-46d0-87d0-078ff6aab9fa {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:14:44 user nova-compute[75288]: INFO nova.compute.manager [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Took 6.22 seconds to build instance.
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-666197718',display_name='tempest-AttachVolumeTestJSON-server-666197718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-666197718',id=46,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGGr5g/Ok1nSyHA61gFCD6qIK+SYhlfm+CZ6lM2J9F90t2G8b2lxcfsuyF3mFEA4rzT9jkJSBqTbR+2hb5i9PQH0J1ueQqTQfAOtafTcpQ4A/hHgTynmIrdkVlcyDgQ5w==',key_name='tempest-keypair-1957552402',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:11:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d43be7c75dc4274801b9860ded7693d',ramdisk_id='',reservation_id='r-h0bbd2qf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-800128847',owner_user_name='tempest-AttachVolumeTestJSON-800128847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9ce70853828047c2a95d82b34f79cc96',uuid=48339b96-a50f-46d0-87d0-078ff6aab9fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converting VIF {"id": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "address": "fa:16:3e:6e:19:31", "network": {"id": "9ab33578-af88-4d9d-9b71-2dc8e356b4eb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1315763806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d43be7c75dc4274801b9860ded7693d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4fdb8d-aa", "ovs_interfaceid": "3f4fdb8d-aaca-4d48-912b-63b5e79671e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:19:31,bridge_name='br-int',has_traffic_filtering=True,id=3f4fdb8d-aaca-4d48-912b-63b5e79671e7,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4fdb8d-aa') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG os_vif [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:19:31,bridge_name='br-int',has_traffic_filtering=True,id=3f4fdb8d-aaca-4d48-912b-63b5e79671e7,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4fdb8d-aa') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f4fdb8d-aa, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c3a80dc-5f15-41ef-9530-cb1e89f43f80) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:44 user nova-compute[75288]: INFO os_vif [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:19:31,bridge_name='br-int',has_traffic_filtering=True,id=3f4fdb8d-aaca-4d48-912b-63b5e79671e7,network=Network(9ab33578-af88-4d9d-9b71-2dc8e356b4eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4fdb8d-aa')
Dec 01 14:14:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Deleting instance files /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa_del
Dec 01 14:14:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Deletion of /opt/stack/data/nova/instances/48339b96-a50f-46d0-87d0-078ff6aab9fa_del complete
Dec 01 14:14:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-eb846973-001d-45be-9957-295cd284b9e4 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.353s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:44 user nova-compute[75288]: INFO nova.compute.manager [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 01 14:14:44 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:14:44 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:14:45 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:14:45 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Took 0.89 seconds to deallocate network for instance.
Dec 01 14:14:45 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b3c836f-4c38-4e14-865b-c596829b78db req-93430acd-55e2-45c1-8d14-701e2e48f2d1 service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received event network-vif-deleted-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:45 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:14:45 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:14:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:45 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Deleted allocations for instance 48339b96-a50f-46d0-87d0-078ff6aab9fa
Dec 01 14:14:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-435a09a4-5987-48a7-8706-b337b01dd1e7 tempest-AttachVolumeTestJSON-800128847 tempest-AttachVolumeTestJSON-800128847-project-member] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.233s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-4dbe3d62-68d5-43fd-bc27-3e3168dcbb0d req-28cd6928-50e2-4cd2-8485-63f56588e24c service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received event network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4dbe3d62-68d5-43fd-bc27-3e3168dcbb0d req-28cd6928-50e2-4cd2-8485-63f56588e24c service nova] Acquiring lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4dbe3d62-68d5-43fd-bc27-3e3168dcbb0d req-28cd6928-50e2-4cd2-8485-63f56588e24c service nova] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-4dbe3d62-68d5-43fd-bc27-3e3168dcbb0d req-28cd6928-50e2-4cd2-8485-63f56588e24c service nova] Lock "48339b96-a50f-46d0-87d0-078ff6aab9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-4dbe3d62-68d5-43fd-bc27-3e3168dcbb0d req-28cd6928-50e2-4cd2-8485-63f56588e24c service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] No waiting events found dispatching network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:46 user nova-compute[75288]: WARNING nova.compute.manager [req-4dbe3d62-68d5-43fd-bc27-3e3168dcbb0d req-28cd6928-50e2-4cd2-8485-63f56588e24c service nova] [instance: 48339b96-a50f-46d0-87d0-078ff6aab9fa] Received unexpected event network-vif-plugged-3f4fdb8d-aaca-4d48-912b-63b5e79671e7 for instance with vm_state deleted and task_state None.
Dec 01 14:14:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:14:52 user nova-compute[75288]: INFO nova.compute.claims [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Claim successful on node user
Dec 01 14:14:52 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:52 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:14:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.policy [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8674c9e9664e4122ae9966afdbebe365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6739624adb2547748e727a851ee65689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:14:53 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Creating image(s)
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "/opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "/opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "/opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk 1073741824" returned: 0 in 0.058s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Successfully created port: 407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.185s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Cannot resize image /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Ensure instance console log exists: /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:53 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Successfully updated port: 407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquired lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-3e843506-b516-4fb8-931c-7f3dbdb27458 req-57e2c454-cc78-41f0-bae7-972f490c9acd service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received event network-changed-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-3e843506-b516-4fb8-931c-7f3dbdb27458 req-57e2c454-cc78-41f0-bae7-972f490c9acd service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Refreshing instance network info cache due to event network-changed-407ad953-8e25-4ce6-8aad-6e0b3afe939d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3e843506-b516-4fb8-931c-7f3dbdb27458 req-57e2c454-cc78-41f0-bae7-972f490c9acd service nova] Acquiring lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updating instance_info_cache with network_info: [{"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Releasing lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Instance network_info: |[{"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3e843506-b516-4fb8-931c-7f3dbdb27458 req-57e2c454-cc78-41f0-bae7-972f490c9acd service nova] Acquired lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-3e843506-b516-4fb8-931c-7f3dbdb27458 req-57e2c454-cc78-41f0-bae7-972f490c9acd service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Refreshing network info cache for port 407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Start _get_guest_xml network_info=[{"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:14:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:14:54 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-723288034',display_name='tempest-AttachVolumeNegativeTest-server-723288034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-723288034',id=49,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqGvViR13ar6eZ5d+YoOq2efFrd5f0CMB4sl+1HAGkiNDwnmW0pckETN2GRlMMI0y7mm32vA+mWIcbmGQzrE4u2UN+bKHcFmC3s1/SKu6goQUizL5GPqbJZ5NMj6CZTzQ==',key_name='tempest-keypair-72797355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-6qu7e442',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=becaef2b-f467-4232-9f15-0b4ee9725722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=407ad953-8e25-4ce6-8aad-6e0b3afe939d,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407ad953-8e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.objects.instance [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'pci_devices' on Instance uuid becaef2b-f467-4232-9f15-0b4ee9725722 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:14:54 user nova-compute[75288]:   <uuid>becaef2b-f467-4232-9f15-0b4ee9725722</uuid>
Dec 01 14:14:54 user nova-compute[75288]:   <name>instance-00000031</name>
Dec 01 14:14:54 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:14:54 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:14:54 user nova-compute[75288]:   <metadata>
Dec 01 14:14:54 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:14:54 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:14:54 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeNegativeTest-server-723288034</nova:name>
Dec 01 14:14:54 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:14:54</nova:creationTime>
Dec 01 14:14:54 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:14:54 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:14:54 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:14:54 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:14:54 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:14:54 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:14:54 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:14:54 user nova-compute[75288]:       <nova:owner>
Dec 01 14:14:54 user nova-compute[75288]:         <nova:user uuid="8674c9e9664e4122ae9966afdbebe365">tempest-AttachVolumeNegativeTest-566842019-project-member</nova:user>
Dec 01 14:14:54 user nova-compute[75288]:         <nova:project uuid="6739624adb2547748e727a851ee65689">tempest-AttachVolumeNegativeTest-566842019</nova:project>
Dec 01 14:14:54 user nova-compute[75288]:       </nova:owner>
Dec 01 14:14:54 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:14:54 user nova-compute[75288]:       <nova:ports>
Dec 01 14:14:54 user nova-compute[75288]:         <nova:port uuid="407ad953-8e25-4ce6-8aad-6e0b3afe939d">
Dec 01 14:14:54 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 14:14:54 user nova-compute[75288]:         </nova:port>
Dec 01 14:14:54 user nova-compute[75288]:       </nova:ports>
Dec 01 14:14:54 user nova-compute[75288]:     </nova:instance>
Dec 01 14:14:54 user nova-compute[75288]:   </metadata>
Dec 01 14:14:54 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:14:54 user nova-compute[75288]:     <system>
Dec 01 14:14:54 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:14:54 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:14:54 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:14:54 user nova-compute[75288]:       <entry name="serial">becaef2b-f467-4232-9f15-0b4ee9725722</entry>
Dec 01 14:14:54 user nova-compute[75288]:       <entry name="uuid">becaef2b-f467-4232-9f15-0b4ee9725722</entry>
Dec 01 14:14:54 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:14:54 user nova-compute[75288]:     </system>
Dec 01 14:14:54 user nova-compute[75288]:   </sysinfo>
Dec 01 14:14:54 user nova-compute[75288]:   <os>
Dec 01 14:14:54 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:14:54 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:14:54 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:14:54 user nova-compute[75288]:   </os>
Dec 01 14:14:54 user nova-compute[75288]:   <features>
Dec 01 14:14:54 user nova-compute[75288]:     <acpi/>
Dec 01 14:14:54 user nova-compute[75288]:     <apic/>
Dec 01 14:14:54 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:14:54 user nova-compute[75288]:   </features>
Dec 01 14:14:54 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:14:54 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:14:54 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:14:54 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:14:54 user nova-compute[75288]:   </clock>
Dec 01 14:14:54 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:14:54 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:14:54 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:14:54 user nova-compute[75288]:   </cpu>
Dec 01 14:14:54 user nova-compute[75288]:   <devices>
Dec 01 14:14:54 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:14:54 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:14:54 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk"/>
Dec 01 14:14:54 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:14:54 user nova-compute[75288]:     </disk>
Dec 01 14:14:54 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:14:54 user nova-compute[75288]:       <mac address="fa:16:3e:e2:4d:f8"/>
Dec 01 14:14:54 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:14:54 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:14:54 user nova-compute[75288]:       <target dev="tap407ad953-8e"/>
Dec 01 14:14:54 user nova-compute[75288]:     </interface>
Dec 01 14:14:54 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:14:54 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/console.log" append="off"/>
Dec 01 14:14:54 user nova-compute[75288]:     </serial>
Dec 01 14:14:54 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:14:54 user nova-compute[75288]:     <video>
Dec 01 14:14:54 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:14:54 user nova-compute[75288]:     </video>
Dec 01 14:14:54 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:14:54 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:14:54 user nova-compute[75288]:     </rng>
Dec 01 14:14:54 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:14:54 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:14:54 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:14:54 user nova-compute[75288]:     </memballoon>
Dec 01 14:14:54 user nova-compute[75288]:   </devices>
Dec 01 14:14:54 user nova-compute[75288]: </domain>
Dec 01 14:14:54 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-723288034',display_name='tempest-AttachVolumeNegativeTest-server-723288034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-723288034',id=49,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqGvViR13ar6eZ5d+YoOq2efFrd5f0CMB4sl+1HAGkiNDwnmW0pckETN2GRlMMI0y7mm32vA+mWIcbmGQzrE4u2UN+bKHcFmC3s1/SKu6goQUizL5GPqbJZ5NMj6CZTzQ==',key_name='tempest-keypair-72797355',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-6qu7e442',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=becaef2b-f467-4232-9f15-0b4ee9725722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=407ad953-8e25-4ce6-8aad-6e0b3afe939d,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407ad953-8e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG os_vif [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=407ad953-8e25-4ce6-8aad-6e0b3afe939d,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407ad953-8e') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3be2f2a-2d22-5879-afa5-4273ccbdf931', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap407ad953-8e, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap407ad953-8e, col_values=(('qos', UUID('524a8b2d-fa5d-4ad8-866e-8b8be649facf')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap407ad953-8e, col_values=(('external_ids', {'iface-id': '407ad953-8e25-4ce6-8aad-6e0b3afe939d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:4d:f8', 'vm-uuid': 'becaef2b-f467-4232-9f15-0b4ee9725722'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:54 user nova-compute[75288]: INFO os_vif [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=407ad953-8e25-4ce6-8aad-6e0b3afe939d,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407ad953-8e')
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No VIF found with MAC fa:16:3e:e2:4d:f8, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-3e843506-b516-4fb8-931c-7f3dbdb27458 req-57e2c454-cc78-41f0-bae7-972f490c9acd service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updated VIF entry in instance network info cache for port 407ad953-8e25-4ce6-8aad-6e0b3afe939d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-3e843506-b516-4fb8-931c-7f3dbdb27458 req-57e2c454-cc78-41f0-bae7-972f490c9acd service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updating instance_info_cache with network_info: [{"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:14:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3e843506-b516-4fb8-931c-7f3dbdb27458 req-57e2c454-cc78-41f0-bae7-972f490c9acd service nova] Releasing lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-31fc4fca-9ebe-4881-93a9-b83a28860add req-03ff4ff8-d913-4c8d-a3d6-bc50991418af service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received event network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31fc4fca-9ebe-4881-93a9-b83a28860add req-03ff4ff8-d913-4c8d-a3d6-bc50991418af service nova] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31fc4fca-9ebe-4881-93a9-b83a28860add req-03ff4ff8-d913-4c8d-a3d6-bc50991418af service nova] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-31fc4fca-9ebe-4881-93a9-b83a28860add req-03ff4ff8-d913-4c8d-a3d6-bc50991418af service nova] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-31fc4fca-9ebe-4881-93a9-b83a28860add req-03ff4ff8-d913-4c8d-a3d6-bc50991418af service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] No waiting events found dispatching network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:56 user nova-compute[75288]: WARNING nova.compute.manager [req-31fc4fca-9ebe-4881-93a9-b83a28860add req-03ff4ff8-d913-4c8d-a3d6-bc50991418af service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received unexpected event network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d for instance with vm_state building and task_state spawning.
Dec 01 14:14:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:14:58 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Instance spawned successfully.
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:14:58 user nova-compute[75288]: INFO nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Took 5.15 seconds to spawn the instance on the hypervisor.
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b1ee903-bf01-4469-8706-516c3e6fc551 req-8615f040-2204-40ad-8148-69a1c3354bd9 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received event network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b1ee903-bf01-4469-8706-516c3e6fc551 req-8615f040-2204-40ad-8148-69a1c3354bd9 service nova] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b1ee903-bf01-4469-8706-516c3e6fc551 req-8615f040-2204-40ad-8148-69a1c3354bd9 service nova] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-3b1ee903-bf01-4469-8706-516c3e6fc551 req-8615f040-2204-40ad-8148-69a1c3354bd9 service nova] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-3b1ee903-bf01-4469-8706-516c3e6fc551 req-8615f040-2204-40ad-8148-69a1c3354bd9 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] No waiting events found dispatching network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:14:58 user nova-compute[75288]: WARNING nova.compute.manager [req-3b1ee903-bf01-4469-8706-516c3e6fc551 req-8615f040-2204-40ad-8148-69a1c3354bd9 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received unexpected event network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d for instance with vm_state building and task_state spawning.
Dec 01 14:14:58 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 14:14:58 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance has had 5 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Dec 01 14:14:58 user nova-compute[75288]: INFO nova.compute.manager [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Took 5.70 seconds to build instance.
Dec 01 14:14:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bb6dd528-6ba6-4676-9428-7fc4073a0037 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.789s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:14:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:15:26 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:15:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:15:27 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8645MB free_disk=24.983123779296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance becaef2b-f467-4232-9f15-0b4ee9725722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing inventories for resource provider 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating ProviderTree inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing aggregate associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 14:15:27 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing trait associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 14:15:28 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:15:28 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:15:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:15:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.496s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:15:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:15:30 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 14:15:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:15:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:15:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:15:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:15:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:15:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:15:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:15:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:15:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:15:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:15:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:15:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:15:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:16:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:16:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:16:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=24.971500396728516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance becaef2b-f467-4232-9f15-0b4ee9725722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:16:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:16:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:16:31 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:16:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:16:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:16:31 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:16:31 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 42eb4684-79a0-4ff3-92b4-e364a39b96b7 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG nova.objects.instance [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'flavor' on Instance uuid 42eb4684-79a0-4ff3-92b4-e364a39b96b7 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:16:32 user nova-compute[75288]: INFO nova.compute.manager [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Attaching volume 3890aeca-41b2-49b2-bbd4-9122402efa4f to /dev/vdb
Dec 01 14:16:32 user nova-compute[75288]: DEBUG os_brick.utils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f8ca9-5960-4a29-9d80-19c3b0676d70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe2a989-c3a4-4632-b597-d88d935359dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c51ef-01f3-4d39-a922-098200180991]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f758290-915c-4697-92f7-bcb3bb7e3ad6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:16:32 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:16:32 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6f806f-8640-4fed-9c39-5df44a5786ca]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG os_brick.utils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:16:32 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating existing volume attachment record: 07ceebaf-e23b-45f0-bc9e-88e30dd1b687 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:16:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:16:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:16:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:16:39 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-f04b34a3-b64c-4154-b86e-7ed1ed474b5a req-d4c0023d-d2b9-4c8d-a482-b4235ac25081 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received event network-changed-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:16:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-f04b34a3-b64c-4154-b86e-7ed1ed474b5a req-d4c0023d-d2b9-4c8d-a482-b4235ac25081 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Refreshing instance network info cache due to event network-changed-407ad953-8e25-4ce6-8aad-6e0b3afe939d. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:16:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f04b34a3-b64c-4154-b86e-7ed1ed474b5a req-d4c0023d-d2b9-4c8d-a482-b4235ac25081 service nova] Acquiring lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:16:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f04b34a3-b64c-4154-b86e-7ed1ed474b5a req-d4c0023d-d2b9-4c8d-a482-b4235ac25081 service nova] Acquired lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:16:43 user nova-compute[75288]: DEBUG nova.network.neutron [req-f04b34a3-b64c-4154-b86e-7ed1ed474b5a req-d4c0023d-d2b9-4c8d-a482-b4235ac25081 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Refreshing network info cache for port 407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-f04b34a3-b64c-4154-b86e-7ed1ed474b5a req-d4c0023d-d2b9-4c8d-a482-b4235ac25081 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updated VIF entry in instance network info cache for port 407ad953-8e25-4ce6-8aad-6e0b3afe939d. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG nova.network.neutron [req-f04b34a3-b64c-4154-b86e-7ed1ed474b5a req-d4c0023d-d2b9-4c8d-a482-b4235ac25081 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updating instance_info_cache with network_info: [{"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-f04b34a3-b64c-4154-b86e-7ed1ed474b5a req-d4c0023d-d2b9-4c8d-a482-b4235ac25081 service nova] Releasing lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:16:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid becaef2b-f467-4232-9f15-0b4ee9725722 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:16:46 user nova-compute[75288]: INFO nova.compute.manager [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Attaching volume efe36459-1749-42e2-8a57-7f01b5c0e180 to /dev/vdb
Dec 01 14:16:46 user nova-compute[75288]: DEBUG os_brick.utils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad283c59-1b82-4e5a-a8fd-339bbce1c4f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d38f8e-06ba-4c29-ad4b-864d9e1bbdad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2564203-07ed-4ce6-86aa-aca1b7204b51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c31dcd8-5ce9-4670-8ae9-bbb20aa4257b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:16:46 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:16:46 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9aef83-8c5a-4db9-b81e-16cd94cd38e6]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG os_brick.utils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:16:46 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updating existing volume attachment record: 52ce37a3-5ed0-444b-8a35-7099a096ec1c {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:16:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUsRzgHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:16:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:16:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:16:49 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:16:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:16:49 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f973d-2780-4fe6-9d10-20b50d30944a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:16:49 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[500ad073-7a99-4df8-82fa-88012c01fcc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f] added
Dec 01 14:16:49 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd31cce-1108-4753-9d3d-4eefc31da07f]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:49 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1869d69-11e5-40b2-a3e0-a0d43d3383c6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUsRzgHM {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUsRzgHM" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e195a59-cb21-48d4-ad3b-93f66cb238a2]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KUsRzgHM'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60d1660-748b-48d5-a2be-1698bdf90e6a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c911b8b4-3e66-49ea-a5cf-7517fb60c981]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:16:50 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:16:50 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:16:50 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 14:16:50 user nova-compute[75288]: 
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9661dd85-5b9a-4001-8416-71c437db0c52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f, portal: 172.16.0.220,3260]
Dec 01 14:16:50 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f, portal: 172.16.0.220,3260] successful.
Dec 01 14:16:50 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[60807555-ec2d-44aa-ace5-1c8fdef98f05]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad4957c-3e59-443b-ba17-deb613cb602c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:16:50 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:16:50 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5003da7-0b22-4616-9bbb-fff20ef2d270]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:50 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUsRzgHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23661663039316434', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661663039316434', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG nova.objects.instance [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'flavor' on Instance uuid 42eb4684-79a0-4ff3-92b4-e364a39b96b7 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:16:51 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:16:51 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:16:51 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:16:51 user nova-compute[75288]:   <serial>3890aeca-41b2-49b2-bbd4-9122402efa4f</serial>
Dec 01 14:16:51 user nova-compute[75288]: </disk>
Dec 01 14:16:51 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] No VIF found with MAC fa:16:3e:8e:d1:ae, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:16:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0a1b84a5-b4bf-464a-b81c-b2b6d16c95f0 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.171s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:16:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6e77dbbd-12c3-43fa-8fe1-ccaf845db2c8 req-7f23cce4-f2f0-4322-aad0-cb07afb94de6 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG nova.compute.manager [req-6e77dbbd-12c3-43fa-8fe1-ccaf845db2c8 req-7f23cce4-f2f0-4322-aad0-cb07afb94de6 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing instance network info cache due to event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e77dbbd-12c3-43fa-8fe1-ccaf845db2c8 req-7f23cce4-f2f0-4322-aad0-cb07afb94de6 service nova] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e77dbbd-12c3-43fa-8fe1-ccaf845db2c8 req-7f23cce4-f2f0-4322-aad0-cb07afb94de6 service nova] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-6e77dbbd-12c3-43fa-8fe1-ccaf845db2c8 req-7f23cce4-f2f0-4322-aad0-cb07afb94de6 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-6e77dbbd-12c3-43fa-8fe1-ccaf845db2c8 req-7f23cce4-f2f0-4322-aad0-cb07afb94de6 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updated VIF entry in instance network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG nova.network.neutron [req-6e77dbbd-12c3-43fa-8fe1-ccaf845db2c8 req-7f23cce4-f2f0-4322-aad0-cb07afb94de6 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6e77dbbd-12c3-43fa-8fe1-ccaf845db2c8 req-7f23cce4-f2f0-4322-aad0-cb07afb94de6 service nova] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:16:54 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b76f8c0-9474-4b45-a6b2-7dad3da3c3b4 req-f4913338-f85e-4330-906e-c5ad130a3f36 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-6b76f8c0-9474-4b45-a6b2-7dad3da3c3b4 req-f4913338-f85e-4330-906e-c5ad130a3f36 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing instance network info cache due to event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b76f8c0-9474-4b45-a6b2-7dad3da3c3b4 req-f4913338-f85e-4330-906e-c5ad130a3f36 service nova] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b76f8c0-9474-4b45-a6b2-7dad3da3c3b4 req-f4913338-f85e-4330-906e-c5ad130a3f36 service nova] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-6b76f8c0-9474-4b45-a6b2-7dad3da3c3b4 req-f4913338-f85e-4330-906e-c5ad130a3f36 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOgKboFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:16:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:16:56 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:16:56 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d5db4e-f237-4131-bd67-4963f274a2d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:16:56 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdda8d4-1de6-4242-b936-84cea9e83e6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180] added
Dec 01 14:16:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9721dc86-ffcb-4b60-888f-3dc4ff12a9f3]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2cdf72-9da8-4146-a874-521e6e6adfc6]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NOgKboFZ {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NOgKboFZ" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4769882d-6f00-4558-97fc-0f2870d6f153]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NOgKboFZ'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[019a57ec-090f-4c0d-a1d8-e36781dc0b4b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[68429a75-0bf2-4d99-8eef-a8d710ec0844]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:16:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:16:56 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:16:56 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00a6a3c-9bc3-4f4d-87e1-be6392e3c3b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180, portal: 172.16.0.220,3260]
Dec 01 14:16:57 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180, portal: 172.16.0.220,3260] successful.
Dec 01 14:16:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7829f1-87fc-48a4-853d-7f9b8e748e71]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeedf6b8-71de-41bc-acb0-d6abc0022e60]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:16:57 user nova-compute[75288]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 (non-flash)
Dec 01 14:16:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:16:57 user nova-compute[75288]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 (non-flash)
Dec 01 14:16:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd20c428-f821-439d-9b56-72ccf4208a20]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOgKboFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:16:57 user nova-compute[75288]: INFO nova.compute.manager [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Rebooting instance
Dec 01 14:16:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-6b76f8c0-9474-4b45-a6b2-7dad3da3c3b4 req-f4913338-f85e-4330-906e-c5ad130a3f36 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updated VIF entry in instance network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-6b76f8c0-9474-4b45-a6b2-7dad3da3c3b4 req-f4913338-f85e-4330-906e-c5ad130a3f36 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6b76f8c0-9474-4b45-a6b2-7dad3da3c3b4 req-f4913338-f85e-4330-906e-c5ad130a3f36 service nova] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG nova.network.neutron [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:16:57 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23465346536613939', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465346536613939', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid becaef2b-f467-4232-9f15-0b4ee9725722 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:16:58 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:16:58 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:16:58 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:16:58 user nova-compute[75288]:   <serial>efe36459-1749-42e2-8a57-7f01b5c0e180</serial>
Dec 01 14:16:58 user nova-compute[75288]: </disk>
Dec 01 14:16:58 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No VIF found with MAC fa:16:3e:e2:4d:f8, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:16:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d72a32be-5dd4-4f33-9f69-7046e52cd317 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.060s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:16:59 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:00 user nova-compute[75288]: INFO nova.compute.manager [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Detaching volume efe36459-1749-42e2-8a57-7f01b5c0e180
Dec 01 14:17:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:00 user nova-compute[75288]: INFO nova.virt.block_device [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Attempting to driver detach volume efe36459-1749-42e2-8a57-7f01b5c0e180 from mountpoint /dev/vdb
Dec 01 14:17:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Attempting to detach device vdb from instance becaef2b-f467-4232-9f15-0b4ee9725722 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:17:00 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:17:00 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:17:00 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:17:00 user nova-compute[75288]:   <serial>efe36459-1749-42e2-8a57-7f01b5c0e180</serial>
Dec 01 14:17:00 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:17:00 user nova-compute[75288]: </disk>
Dec 01 14:17:00 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:17:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully detached device vdb from instance becaef2b-f467-4232-9f15-0b4ee9725722 from the persistent domain config.
Dec 01 14:17:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance becaef2b-f467-4232-9f15-0b4ee9725722 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:17:00 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:17:00 user nova-compute[75288]:   <source dev="/dev/sdc"/>
Dec 01 14:17:00 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:17:00 user nova-compute[75288]:   <serial>efe36459-1749-42e2-8a57-7f01b5c0e180</serial>
Dec 01 14:17:00 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:17:00 user nova-compute[75288]: </disk>
Dec 01 14:17:00 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-ee51c276-fdc3-4015-bd6e-f58678785060 req-12110f7b-2d67-4e36-ba32-0e1184fd88e7 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-unplugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee51c276-fdc3-4015-bd6e-f58678785060 req-12110f7b-2d67-4e36-ba32-0e1184fd88e7 service nova] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee51c276-fdc3-4015-bd6e-f58678785060 req-12110f7b-2d67-4e36-ba32-0e1184fd88e7 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ee51c276-fdc3-4015-bd6e-f58678785060 req-12110f7b-2d67-4e36-ba32-0e1184fd88e7 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG nova.compute.manager [req-ee51c276-fdc3-4015-bd6e-f58678785060 req-12110f7b-2d67-4e36-ba32-0e1184fd88e7 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] No waiting events found dispatching network-vif-unplugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:17:00 user nova-compute[75288]: WARNING nova.compute.manager [req-ee51c276-fdc3-4015-bd6e-f58678785060 req-12110f7b-2d67-4e36-ba32-0e1184fd88e7 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received unexpected event network-vif-unplugged-01aa5dda-3f60-49b5-aaca-418833fea664 for instance with vm_state active and task_state reboot_started.
Dec 01 14:17:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:00 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance becaef2b-f467-4232-9f15-0b4ee9725722 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:17:00 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Instance shutdown successfully.
Dec 01 14:17:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] No waiting events found dispatching network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:17:02 user nova-compute[75288]: WARNING nova.compute.manager [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received unexpected event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 for instance with vm_state active and task_state reboot_started.
Dec 01 14:17:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG nova.compute.manager [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] No waiting events found dispatching network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:17:02 user nova-compute[75288]: WARNING nova.compute.manager [req-b58194b6-5c48-41a7-83da-4c7e14c62cd7 req-b41b7ed2-d1ba-4c7d-897c-7cecf4570f0d service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received unexpected event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 for instance with vm_state active and task_state reboot_started.
Dec 01 14:17:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-64e2cf72-caf5-428b-96ed-4f02ea2ab24b req-36e506ec-6dff-477c-91f8-ad5becc4d92e service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64e2cf72-caf5-428b-96ed-4f02ea2ab24b req-36e506ec-6dff-477c-91f8-ad5becc4d92e service nova] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64e2cf72-caf5-428b-96ed-4f02ea2ab24b req-36e506ec-6dff-477c-91f8-ad5becc4d92e service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64e2cf72-caf5-428b-96ed-4f02ea2ab24b req-36e506ec-6dff-477c-91f8-ad5becc4d92e service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:04 user nova-compute[75288]: DEBUG nova.compute.manager [req-64e2cf72-caf5-428b-96ed-4f02ea2ab24b req-36e506ec-6dff-477c-91f8-ad5becc4d92e service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] No waiting events found dispatching network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:17:04 user nova-compute[75288]: WARNING nova.compute.manager [req-64e2cf72-caf5-428b-96ed-4f02ea2ab24b req-36e506ec-6dff-477c-91f8-ad5becc4d92e service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received unexpected event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 for instance with vm_state active and task_state reboot_started.
Dec 01 14:17:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Instance running successfully.
Dec 01 14:17:04 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Instance soft rebooted successfully.
Dec 01 14:17:04 user nova-compute[75288]: DEBUG nova.compute.manager [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:17:04 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-bc31cbc1-dc5e-42b9-983d-930be3f7e894 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.647s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:04 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:09 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:20 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance becaef2b-f467-4232-9f15-0b4ee9725722 is timed out.
Dec 01 14:17:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully detached device vdb from instance becaef2b-f467-4232-9f15-0b4ee9725722 from the live domain config.
Dec 01 14:17:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NOgKboFZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:17:20 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:17:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14bfbd0-3b36-40c8-98c3-aaf0bc10b2d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:17:20 user nova-compute[75288]: No targets found.
Dec 01 14:17:20 user nova-compute[75288]: iSNS:
Dec 01 14:17:20 user nova-compute[75288]: No targets found.
Dec 01 14:17:20 user nova-compute[75288]: STATIC:
Dec 01 14:17:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f
Dec 01 14:17:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:17:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:17:20 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180
Dec 01 14:17:20 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:17:20 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:17:20 user nova-compute[75288]: FIRMWARE:
Dec 01 14:17:20 user nova-compute[75288]: No targets found.
Dec 01 14:17:20 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:17:20 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:17:20 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:17:20 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac1f7ea-5e9a-4108-8de2-759196f0a07c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46a4710-4346-418c-a82d-def6ec609089]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:17:21 user nova-compute[75288]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 (non-flash)
Dec 01 14:17:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:17:21 user nova-compute[75288]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 (non-flash)
Dec 01 14:17:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98ed12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74f4614-46ea-4f0c-a69a-5bcc6af97fa9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4cae0b-7f40-4c75-a34d-18b08d27c116]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b80230-58af-444e-b32e-aba28ef5b090]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16bdc6a-1790-4ea2-9275-f19f51bbe303]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aefb51-cc26-4ad4-b370-8dd0d36f2666]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2472e722-fa3e-40e7-9425-5db67c8a9b07]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180, portal: 172.16.0.220,3260]
Dec 01 14:17:21 user nova-compute[75288]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180, portal: 172.16.0.220,3260] successful.
Dec 01 14:17:21 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:efe36459-1749-42e2-8a57-7f01b5c0e180 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[250ca82b-f4b1-45ef-ba3b-a7278745cbbf]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== disconnect_volume: return (338ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:17:21 user nova-compute[75288]: INFO nova.compute.claims [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Claim successful on node user
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:17:21 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG nova.policy [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67d2e20a449a40a7af858040cd775587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14db84cd86654aad9f8564d909447c62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:17:21 user nova-compute[75288]: INFO nova.virt.block_device [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Booting with volume 6bb2c872-8a6f-42b4-b454-e05de63d990b at /dev/vda
Dec 01 14:17:21 user nova-compute[75288]: DEBUG os_brick.utils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7d255f-f8f2-4b95-bb80-bfd373f165c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:21 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c7baa6-a3db-4d09-b9b9-694de70e1bca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff1e809-d702-472a-a4b9-8010a708205b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cca94fd-adf3-4191-a939-41b341cc38af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:17:22 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba91596a-e843-40df-a5ab-3227de40b0da]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG os_brick.utils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating existing volume attachment record: 37c4f8aa-3b02-4745-8e6b-cda7ee5bd9e3 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid becaef2b-f467-4232-9f15-0b4ee9725722 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fd79e178-09b5-4729-9a9c-4e7867b13520 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.260s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:22 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Successfully created port: eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Successfully updated port: eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-7eca955c-5f11-43a8-906f-097b04d2884a req-57936237-e6f1-4bb5-9cbc-379e6c0f3d9e service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG nova.compute.manager [req-7eca955c-5f11-43a8-906f-097b04d2884a req-57936237-e6f1-4bb5-9cbc-379e6c0f3d9e service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing instance network info cache due to event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7eca955c-5f11-43a8-906f-097b04d2884a req-57936237-e6f1-4bb5-9cbc-379e6c0f3d9e service nova] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG nova.network.neutron [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance network_info: |[{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7eca955c-5f11-43a8-906f-097b04d2884a req-57936237-e6f1-4bb5-9cbc-379e6c0f3d9e service nova] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:17:23 user nova-compute[75288]: DEBUG nova.network.neutron [req-7eca955c-5f11-43a8-906f-097b04d2884a req-57936237-e6f1-4bb5-9cbc-379e6c0f3d9e service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:17:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-7eca955c-5f11-43a8-906f-097b04d2884a req-57936237-e6f1-4bb5-9cbc-379e6c0f3d9e service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updated VIF entry in instance network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:17:24 user nova-compute[75288]: DEBUG nova.network.neutron [req-7eca955c-5f11-43a8-906f-097b04d2884a req-57936237-e6f1-4bb5-9cbc-379e6c0f3d9e service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:17:24 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-7eca955c-5f11-43a8-906f-097b04d2884a req-57936237-e6f1-4bb5-9cbc-379e6c0f3d9e service nova] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:17:24 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:28 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:17:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:17:29 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=24.958049774169922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance becaef2b-f467-4232-9f15-0b4ee9725722 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:29 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:17:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:17:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:17:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:17:33 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:33 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updating instance_info_cache with network_info: [{"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:17:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-becaef2b-f467-4232-9f15-0b4ee9725722" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:17:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:17:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:34 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:17:35 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Creating image(s)
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Ensure instance console log exists: /opt/stack/data/nova/instances/0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Start _get_guest_xml network_info=[{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '37c4f8aa-3b02-4745-8e6b-cda7ee5bd9e3', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJeCkZUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3', 'attached_at': '', 'detached_at': '', 'volume_id': '6bb2c872-8a6f-42b4-b454-e05de63d990b', 'serial': '6bb2c872-8a6f-42b4-b454-e05de63d990b'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:17:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:17:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJeCkZUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:17:35 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:17:35 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:17:35 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa966c5-a512-4062-8609-b292a6f62f9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:17:35 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa6efb-6f6a-41ef-bd7f-98af61d550bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b] added
Dec 01 14:17:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[992e436f-12c6-4d54-99e6-251a2d26cf86]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e5c7f4-c655-4e69-955d-e39a8e970109]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJeCkZUc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJeCkZUc" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f76d09-ec57-4b6c-b3e4-ec1558ec2417]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJeCkZUc'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53ff285-fe50-4583-abf7-2af573a99940]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25173df-f91a-4ec6-86bf-6f75eb9cb1db]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:17:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:17:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d23de-f68b-4820-9340-b178d55e1456]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260]
Dec 01 14:17:35 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260] successful.
Dec 01 14:17:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f3706-5d2a-4983-9061-1e919c8e0efe]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da5438-13f7-486f-83c7-d0fad3b31767]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:17:35 user nova-compute[75288]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:17:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:17:35 user nova-compute[75288]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:17:35 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[574dac9a-2d8d-407a-aa38-e1dfad135ebb]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:17:35 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJeCkZUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23065636137616131', 'path': '/dev/sdc'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065636137616131', 'path': '/dev/sdc'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-191619064',display_name='tempest-TestShelveInstance-server-191619064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-191619064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaTfWqFnScfDQvc1iGBKh7J9lY1UZczsoJeq95eSWXbM+O9s/k/RlP113Er93a2KBe7P8P/gG5zTmrn6ikETkZvKarDBTU1lO7zmH2LVcr12lslMObr4WQn5C4zKcFJqw==',key_name='tempest-TestShelveInstance-2098869375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14db84cd86654aad9f8564d909447c62',ramdisk_id='',reservation_id='r-rkq5nofm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-599310837',owner_user_name='tempest-TestShelveInstance-599310837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:17:22Z,user_data=None,user_id='67d2e20a449a40a7af858040cd775587',uuid=0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converting VIF {"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lazy-loading 'pci_devices' on Instance uuid 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:17:36 user nova-compute[75288]:   <uuid>0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3</uuid>
Dec 01 14:17:36 user nova-compute[75288]:   <name>instance-00000032</name>
Dec 01 14:17:36 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:17:36 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:17:36 user nova-compute[75288]:   <metadata>
Dec 01 14:17:36 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:17:36 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:17:36 user nova-compute[75288]:       <nova:name>tempest-TestShelveInstance-server-191619064</nova:name>
Dec 01 14:17:36 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:17:35</nova:creationTime>
Dec 01 14:17:36 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:17:36 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:17:36 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:17:36 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:17:36 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:17:36 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:17:36 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:17:36 user nova-compute[75288]:       <nova:owner>
Dec 01 14:17:36 user nova-compute[75288]:         <nova:user uuid="67d2e20a449a40a7af858040cd775587">tempest-TestShelveInstance-599310837-project-member</nova:user>
Dec 01 14:17:36 user nova-compute[75288]:         <nova:project uuid="14db84cd86654aad9f8564d909447c62">tempest-TestShelveInstance-599310837</nova:project>
Dec 01 14:17:36 user nova-compute[75288]:       </nova:owner>
Dec 01 14:17:36 user nova-compute[75288]:       <nova:ports>
Dec 01 14:17:36 user nova-compute[75288]:         <nova:port uuid="eb02f0ed-891c-4dfb-a17c-6b76d882c6f5">
Dec 01 14:17:36 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 14:17:36 user nova-compute[75288]:         </nova:port>
Dec 01 14:17:36 user nova-compute[75288]:       </nova:ports>
Dec 01 14:17:36 user nova-compute[75288]:     </nova:instance>
Dec 01 14:17:36 user nova-compute[75288]:   </metadata>
Dec 01 14:17:36 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:17:36 user nova-compute[75288]:     <system>
Dec 01 14:17:36 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:17:36 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:17:36 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:17:36 user nova-compute[75288]:       <entry name="serial">0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3</entry>
Dec 01 14:17:36 user nova-compute[75288]:       <entry name="uuid">0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3</entry>
Dec 01 14:17:36 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:17:36 user nova-compute[75288]:     </system>
Dec 01 14:17:36 user nova-compute[75288]:   </sysinfo>
Dec 01 14:17:36 user nova-compute[75288]:   <os>
Dec 01 14:17:36 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:17:36 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:17:36 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:17:36 user nova-compute[75288]:   </os>
Dec 01 14:17:36 user nova-compute[75288]:   <features>
Dec 01 14:17:36 user nova-compute[75288]:     <acpi/>
Dec 01 14:17:36 user nova-compute[75288]:     <apic/>
Dec 01 14:17:36 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:17:36 user nova-compute[75288]:   </features>
Dec 01 14:17:36 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:17:36 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:17:36 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:17:36 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:17:36 user nova-compute[75288]:   </clock>
Dec 01 14:17:36 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:17:36 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:17:36 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:17:36 user nova-compute[75288]:   </cpu>
Dec 01 14:17:36 user nova-compute[75288]:   <devices>
Dec 01 14:17:36 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 14:17:36 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:17:36 user nova-compute[75288]:       <source dev="/dev/sdc"/>
Dec 01 14:17:36 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:17:36 user nova-compute[75288]:       <serial>6bb2c872-8a6f-42b4-b454-e05de63d990b</serial>
Dec 01 14:17:36 user nova-compute[75288]:     </disk>
Dec 01 14:17:36 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:17:36 user nova-compute[75288]:       <mac address="fa:16:3e:cd:4e:b0"/>
Dec 01 14:17:36 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:17:36 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:17:36 user nova-compute[75288]:       <target dev="tapeb02f0ed-89"/>
Dec 01 14:17:36 user nova-compute[75288]:     </interface>
Dec 01 14:17:36 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:17:36 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3/console.log" append="off"/>
Dec 01 14:17:36 user nova-compute[75288]:     </serial>
Dec 01 14:17:36 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:17:36 user nova-compute[75288]:     <video>
Dec 01 14:17:36 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:17:36 user nova-compute[75288]:     </video>
Dec 01 14:17:36 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:17:36 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:17:36 user nova-compute[75288]:     </rng>
Dec 01 14:17:36 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:17:36 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:17:36 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:17:36 user nova-compute[75288]:     </memballoon>
Dec 01 14:17:36 user nova-compute[75288]:   </devices>
Dec 01 14:17:36 user nova-compute[75288]: </domain>
Dec 01 14:17:36 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-191619064',display_name='tempest-TestShelveInstance-server-191619064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-191619064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaTfWqFnScfDQvc1iGBKh7J9lY1UZczsoJeq95eSWXbM+O9s/k/RlP113Er93a2KBe7P8P/gG5zTmrn6ikETkZvKarDBTU1lO7zmH2LVcr12lslMObr4WQn5C4zKcFJqw==',key_name='tempest-TestShelveInstance-2098869375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14db84cd86654aad9f8564d909447c62',ramdisk_id='',reservation_id='r-rkq5nofm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-599310837',owner_user_name='tempest-TestShelveInstance-599310837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:17:22Z,user_data=None,user_id='67d2e20a449a40a7af858040cd775587',uuid=0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converting VIF {"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG os_vif [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3653b154-3a8c-50da-a457-ce85233d7c7a', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb02f0ed-89, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb02f0ed-89, col_values=(('qos', UUID('4cbefeab-9830-40d4-895f-49b79d81076e')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb02f0ed-89, col_values=(('external_ids', {'iface-id': 'eb02f0ed-891c-4dfb-a17c-6b76d882c6f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:4e:b0', 'vm-uuid': '0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:36 user nova-compute[75288]: INFO os_vif [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89')
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:17:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] No VIF found with MAC fa:16:3e:cd:4e:b0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:17:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-857cf0fa-7090-443c-b042-5a60ebd6fcf0 req-81381ee1-e4cd-4102-bd30-583118e3e707 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-857cf0fa-7090-443c-b042-5a60ebd6fcf0 req-81381ee1-e4cd-4102-bd30-583118e3e707 service nova] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-857cf0fa-7090-443c-b042-5a60ebd6fcf0 req-81381ee1-e4cd-4102-bd30-583118e3e707 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-857cf0fa-7090-443c-b042-5a60ebd6fcf0 req-81381ee1-e4cd-4102-bd30-583118e3e707 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG nova.compute.manager [req-857cf0fa-7090-443c-b042-5a60ebd6fcf0 req-81381ee1-e4cd-4102-bd30-583118e3e707 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] No waiting events found dispatching network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:17:38 user nova-compute[75288]: WARNING nova.compute.manager [req-857cf0fa-7090-443c-b042-5a60ebd6fcf0 req-81381ee1-e4cd-4102-bd30-583118e3e707 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received unexpected event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 for instance with vm_state building and task_state spawning.
Dec 01 14:17:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:17:40 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance spawned successfully.
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:17:40 user nova-compute[75288]: INFO nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Took 4.97 seconds to spawn the instance on the hypervisor.
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:17:40 user nova-compute[75288]: INFO nova.compute.manager [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Took 18.85 seconds to build instance.
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-ad9f3d3b-ea0b-4ef2-a7dd-f4a4a0ebb586 req-dcfca57e-6ca7-494e-aedf-50080a25ec9a service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ad9f3d3b-ea0b-4ef2-a7dd-f4a4a0ebb586 req-dcfca57e-6ca7-494e-aedf-50080a25ec9a service nova] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ad9f3d3b-ea0b-4ef2-a7dd-f4a4a0ebb586 req-dcfca57e-6ca7-494e-aedf-50080a25ec9a service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-ad9f3d3b-ea0b-4ef2-a7dd-f4a4a0ebb586 req-dcfca57e-6ca7-494e-aedf-50080a25ec9a service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:40 user nova-compute[75288]: DEBUG nova.compute.manager [req-ad9f3d3b-ea0b-4ef2-a7dd-f4a4a0ebb586 req-dcfca57e-6ca7-494e-aedf-50080a25ec9a service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] No waiting events found dispatching network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:17:40 user nova-compute[75288]: WARNING nova.compute.manager [req-ad9f3d3b-ea0b-4ef2-a7dd-f4a4a0ebb586 req-dcfca57e-6ca7-494e-aedf-50080a25ec9a service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received unexpected event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 for instance with vm_state active and task_state None.
Dec 01 14:17:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-fca52cfd-cdde-4c16-b81c-abe8930d6447 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.993s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:17:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:50 user nova-compute[75288]: INFO nova.compute.manager [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Terminating instance
Dec 01 14:17:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-64d8aca1-61fe-4543-af90-af26de7f9f54 req-fa438878-e78a-488f-ac00-37c2f7da70b7 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received event network-vif-unplugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64d8aca1-61fe-4543-af90-af26de7f9f54 req-fa438878-e78a-488f-ac00-37c2f7da70b7 service nova] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64d8aca1-61fe-4543-af90-af26de7f9f54 req-fa438878-e78a-488f-ac00-37c2f7da70b7 service nova] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-64d8aca1-61fe-4543-af90-af26de7f9f54 req-fa438878-e78a-488f-ac00-37c2f7da70b7 service nova] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-64d8aca1-61fe-4543-af90-af26de7f9f54 req-fa438878-e78a-488f-ac00-37c2f7da70b7 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] No waiting events found dispatching network-vif-unplugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:17:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-64d8aca1-61fe-4543-af90-af26de7f9f54 req-fa438878-e78a-488f-ac00-37c2f7da70b7 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received event network-vif-unplugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:17:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Instance destroyed successfully.
Dec 01 14:17:51 user nova-compute[75288]: DEBUG nova.objects.instance [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'resources' on Instance uuid becaef2b-f467-4232-9f15-0b4ee9725722 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-723288034',display_name='tempest-AttachVolumeNegativeTest-server-723288034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-723288034',id=49,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqGvViR13ar6eZ5d+YoOq2efFrd5f0CMB4sl+1HAGkiNDwnmW0pckETN2GRlMMI0y7mm32vA+mWIcbmGQzrE4u2UN+bKHcFmC3s1/SKu6goQUizL5GPqbJZ5NMj6CZTzQ==',key_name='tempest-keypair-72797355',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:14:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-6qu7e442',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=becaef2b-f467-4232-9f15-0b4ee9725722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "address": "fa:16:3e:e2:4d:f8", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap407ad953-8e", "ovs_interfaceid": "407ad953-8e25-4ce6-8aad-6e0b3afe939d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=407ad953-8e25-4ce6-8aad-6e0b3afe939d,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407ad953-8e') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG os_vif [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=407ad953-8e25-4ce6-8aad-6e0b3afe939d,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407ad953-8e') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap407ad953-8e, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=524a8b2d-fa5d-4ad8-866e-8b8be649facf) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:17:51 user nova-compute[75288]: INFO os_vif [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:4d:f8,bridge_name='br-int',has_traffic_filtering=True,id=407ad953-8e25-4ce6-8aad-6e0b3afe939d,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap407ad953-8e')
Dec 01 14:17:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Deleting instance files /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722_del
Dec 01 14:17:51 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Deletion of /opt/stack/data/nova/instances/becaef2b-f467-4232-9f15-0b4ee9725722_del complete
Dec 01 14:17:51 user nova-compute[75288]: INFO nova.compute.manager [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 01 14:17:51 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:17:51 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:17:52 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Took 0.84 seconds to deallocate network for instance.
Dec 01 14:17:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-59e94149-a07f-442c-ac61-fdb76147e669 req-23811f86-db95-4ef4-87a3-8f18b0819f66 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received event network-vif-deleted-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:52 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Deleted allocations for instance becaef2b-f467-4232-9f15-0b4ee9725722
Dec 01 14:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-0e997906-29ee-45b6-9c89-058616442cb8 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "becaef2b-f467-4232-9f15-0b4ee9725722" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-094a11ca-e60e-48e3-8a11-f393bae77ac6 req-245cede2-f3de-4b70-b649-24debaa78395 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received event network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-094a11ca-e60e-48e3-8a11-f393bae77ac6 req-245cede2-f3de-4b70-b649-24debaa78395 service nova] Acquiring lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-094a11ca-e60e-48e3-8a11-f393bae77ac6 req-245cede2-f3de-4b70-b649-24debaa78395 service nova] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-094a11ca-e60e-48e3-8a11-f393bae77ac6 req-245cede2-f3de-4b70-b649-24debaa78395 service nova] Lock "becaef2b-f467-4232-9f15-0b4ee9725722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:17:52 user nova-compute[75288]: DEBUG nova.compute.manager [req-094a11ca-e60e-48e3-8a11-f393bae77ac6 req-245cede2-f3de-4b70-b649-24debaa78395 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] No waiting events found dispatching network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:17:52 user nova-compute[75288]: WARNING nova.compute.manager [req-094a11ca-e60e-48e3-8a11-f393bae77ac6 req-245cede2-f3de-4b70-b649-24debaa78395 service nova] [instance: becaef2b-f467-4232-9f15-0b4ee9725722] Received unexpected event network-vif-plugged-407ad953-8e25-4ce6-8aad-6e0b3afe939d for instance with vm_state deleted and task_state None.
Dec 01 14:17:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:17:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:03 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:18:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:18:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:30 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:18:31 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:18:31 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:18:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=24.984172821044922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:18:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 42eb4684-79a0-4ff3-92b4-e364a39b96b7 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:18:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:18:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:18:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:18:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:18:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:18:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Starting instance... {{(pid=75288) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:18:44 user nova-compute[75288]: INFO nova.compute.claims [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Claim successful on node user
Dec 01 14:18:44 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Start building networks asynchronously for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Allocating IP information in the background. {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 14:18:44 user nova-compute[75288]: DEBUG nova.network.neutron [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] allocate_for_instance() {{(pid=75288) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 14:18:44 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 14:18:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Start building block device mappings for instance. {{(pid=75288) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG nova.policy [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8674c9e9664e4122ae9966afdbebe365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6739624adb2547748e727a851ee65689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75288) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Start spawning the instance on the hypervisor. {{(pid=75288) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:18:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Creating image(s)
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "/opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "/opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "/opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.176s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.184s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk 1073741824 {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a,backing_fmt=raw /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk 1073741824" returned: 0 in 0.052s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "e623cb687103a093ee52879bc3a63ccf66a4f57a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a --force-share --output=json" returned: 0 in 0.219s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk. size=1073741824 {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:45 user nova-compute[75288]: DEBUG nova.network.neutron [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Successfully created port: e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG nova.virt.disk.api [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Cannot resize image /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk to a smaller size. {{(pid=75288) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Created local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Ensure instance console log exists: /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Successfully updated port: e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquired lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fded7d2-78ba-461a-9bd5-bdebccefc9bd req-17ae7c38-1c19-4690-9f5c-e7782c4962ff service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received event network-changed-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG nova.compute.manager [req-1fded7d2-78ba-461a-9bd5-bdebccefc9bd req-17ae7c38-1c19-4690-9f5c-e7782c4962ff service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Refreshing instance network info cache due to event network-changed-e19d6b06-b434-46ab-bf6a-520de7f76c87. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fded7d2-78ba-461a-9bd5-bdebccefc9bd req-17ae7c38-1c19-4690-9f5c-e7782c4962ff service nova] Acquiring lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:18:46 user nova-compute[75288]: DEBUG nova.network.neutron [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Instance cache missing network info. {{(pid=75288) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.network.neutron [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updating instance_info_cache with network_info: [{"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Releasing lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Instance network_info: |[{"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75288) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fded7d2-78ba-461a-9bd5-bdebccefc9bd req-17ae7c38-1c19-4690-9f5c-e7782c4962ff service nova] Acquired lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-1fded7d2-78ba-461a-9bd5-bdebccefc9bd req-17ae7c38-1c19-4690-9f5c-e7782c4962ff service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Refreshing network info cache for port e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Start _get_guest_xml network_info=[{"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'size': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'image_id': '5960f30f-79c5-4c7d-9bd0-41d5142b4539'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:18:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:18:47 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T13:39:26Z,direct_url=<?>,disk_format='qcow2',id=5960f30f-79c5-4c7d-9bd0-41d5142b4539,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e8c19a51c432440b8289ab0896f37cc0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T13:39:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1376689677',display_name='tempest-AttachVolumeNegativeTest-server-1376689677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1376689677',id=51,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYrI28a8gp0x3Xp36zeGA09sBAmqkPbak0V49wVmvDUu4fdWnwusXpKym6dv4Qo8UlndxhUErINmtzoDlWoxT6f4yuJWG9vXWom+yN2OiExoQy0THlEFLXjj7ovVwwyZA==',key_name='tempest-keypair-1340734752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-jod0zur0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=14ab8b13-2168-4bc6-b9d5-337a4e54a50f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=e19d6b06-b434-46ab-bf6a-520de7f76c87,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19d6b06-b4') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.objects.instance [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'pci_devices' on Instance uuid 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:18:47 user nova-compute[75288]:   <uuid>14ab8b13-2168-4bc6-b9d5-337a4e54a50f</uuid>
Dec 01 14:18:47 user nova-compute[75288]:   <name>instance-00000033</name>
Dec 01 14:18:47 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:18:47 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:18:47 user nova-compute[75288]:   <metadata>
Dec 01 14:18:47 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:18:47 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:18:47 user nova-compute[75288]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1376689677</nova:name>
Dec 01 14:18:47 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:18:47</nova:creationTime>
Dec 01 14:18:47 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:18:47 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:18:47 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:18:47 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:18:47 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:18:47 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:18:47 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:18:47 user nova-compute[75288]:       <nova:owner>
Dec 01 14:18:47 user nova-compute[75288]:         <nova:user uuid="8674c9e9664e4122ae9966afdbebe365">tempest-AttachVolumeNegativeTest-566842019-project-member</nova:user>
Dec 01 14:18:47 user nova-compute[75288]:         <nova:project uuid="6739624adb2547748e727a851ee65689">tempest-AttachVolumeNegativeTest-566842019</nova:project>
Dec 01 14:18:47 user nova-compute[75288]:       </nova:owner>
Dec 01 14:18:47 user nova-compute[75288]:       <nova:root type="image" uuid="5960f30f-79c5-4c7d-9bd0-41d5142b4539"/>
Dec 01 14:18:47 user nova-compute[75288]:       <nova:ports>
Dec 01 14:18:47 user nova-compute[75288]:         <nova:port uuid="e19d6b06-b434-46ab-bf6a-520de7f76c87">
Dec 01 14:18:47 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 14:18:47 user nova-compute[75288]:         </nova:port>
Dec 01 14:18:47 user nova-compute[75288]:       </nova:ports>
Dec 01 14:18:47 user nova-compute[75288]:     </nova:instance>
Dec 01 14:18:47 user nova-compute[75288]:   </metadata>
Dec 01 14:18:47 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:18:47 user nova-compute[75288]:     <system>
Dec 01 14:18:47 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:18:47 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:18:47 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:18:47 user nova-compute[75288]:       <entry name="serial">14ab8b13-2168-4bc6-b9d5-337a4e54a50f</entry>
Dec 01 14:18:47 user nova-compute[75288]:       <entry name="uuid">14ab8b13-2168-4bc6-b9d5-337a4e54a50f</entry>
Dec 01 14:18:47 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:18:47 user nova-compute[75288]:     </system>
Dec 01 14:18:47 user nova-compute[75288]:   </sysinfo>
Dec 01 14:18:47 user nova-compute[75288]:   <os>
Dec 01 14:18:47 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:18:47 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:18:47 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:18:47 user nova-compute[75288]:   </os>
Dec 01 14:18:47 user nova-compute[75288]:   <features>
Dec 01 14:18:47 user nova-compute[75288]:     <acpi/>
Dec 01 14:18:47 user nova-compute[75288]:     <apic/>
Dec 01 14:18:47 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:18:47 user nova-compute[75288]:   </features>
Dec 01 14:18:47 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:18:47 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:18:47 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:18:47 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:18:47 user nova-compute[75288]:   </clock>
Dec 01 14:18:47 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:18:47 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:18:47 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:18:47 user nova-compute[75288]:   </cpu>
Dec 01 14:18:47 user nova-compute[75288]:   <devices>
Dec 01 14:18:47 user nova-compute[75288]:     <disk type="file" device="disk">
Dec 01 14:18:47 user nova-compute[75288]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 14:18:47 user nova-compute[75288]:       <source file="/opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk"/>
Dec 01 14:18:47 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:18:47 user nova-compute[75288]:     </disk>
Dec 01 14:18:47 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:18:47 user nova-compute[75288]:       <mac address="fa:16:3e:35:b1:e0"/>
Dec 01 14:18:47 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:18:47 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:18:47 user nova-compute[75288]:       <target dev="tape19d6b06-b4"/>
Dec 01 14:18:47 user nova-compute[75288]:     </interface>
Dec 01 14:18:47 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:18:47 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/console.log" append="off"/>
Dec 01 14:18:47 user nova-compute[75288]:     </serial>
Dec 01 14:18:47 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:18:47 user nova-compute[75288]:     <video>
Dec 01 14:18:47 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:18:47 user nova-compute[75288]:     </video>
Dec 01 14:18:47 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:18:47 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:18:47 user nova-compute[75288]:     </rng>
Dec 01 14:18:47 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:18:47 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:18:47 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:18:47 user nova-compute[75288]:     </memballoon>
Dec 01 14:18:47 user nova-compute[75288]:   </devices>
Dec 01 14:18:47 user nova-compute[75288]: </domain>
Dec 01 14:18:47 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1376689677',display_name='tempest-AttachVolumeNegativeTest-server-1376689677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1376689677',id=51,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYrI28a8gp0x3Xp36zeGA09sBAmqkPbak0V49wVmvDUu4fdWnwusXpKym6dv4Qo8UlndxhUErINmtzoDlWoxT6f4yuJWG9vXWom+yN2OiExoQy0THlEFLXjj7ovVwwyZA==',key_name='tempest-keypair-1340734752',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-jod0zur0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T14:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=14ab8b13-2168-4bc6-b9d5-337a4e54a50f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=e19d6b06-b434-46ab-bf6a-520de7f76c87,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19d6b06-b4') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG os_vif [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=e19d6b06-b434-46ab-bf6a-520de7f76c87,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19d6b06-b4') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cd6eeac-1423-554c-8b2e-a7f1e03f7ade', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape19d6b06-b4, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape19d6b06-b4, col_values=(('qos', UUID('33b250c0-1177-4e6d-86fd-246b44d693b9')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape19d6b06-b4, col_values=(('external_ids', {'iface-id': 'e19d6b06-b434-46ab-bf6a-520de7f76c87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:b1:e0', 'vm-uuid': '14ab8b13-2168-4bc6-b9d5-337a4e54a50f'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:47 user nova-compute[75288]: INFO os_vif [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=e19d6b06-b434-46ab-bf6a-520de7f76c87,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19d6b06-b4')
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No VIF found with MAC fa:16:3e:35:b1:e0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-1fded7d2-78ba-461a-9bd5-bdebccefc9bd req-17ae7c38-1c19-4690-9f5c-e7782c4962ff service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updated VIF entry in instance network info cache for port e19d6b06-b434-46ab-bf6a-520de7f76c87. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG nova.network.neutron [req-1fded7d2-78ba-461a-9bd5-bdebccefc9bd req-17ae7c38-1c19-4690-9f5c-e7782c4962ff service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updating instance_info_cache with network_info: [{"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:18:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1fded7d2-78ba-461a-9bd5-bdebccefc9bd req-17ae7c38-1c19-4690-9f5c-e7782c4962ff service nova] Releasing lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-a26f61ae-622d-4971-bb10-d74b2a9fc89a req-f9d88260-8584-43d1-9445-65e2d12fc18d service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received event network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a26f61ae-622d-4971-bb10-d74b2a9fc89a req-f9d88260-8584-43d1-9445-65e2d12fc18d service nova] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a26f61ae-622d-4971-bb10-d74b2a9fc89a req-f9d88260-8584-43d1-9445-65e2d12fc18d service nova] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-a26f61ae-622d-4971-bb10-d74b2a9fc89a req-f9d88260-8584-43d1-9445-65e2d12fc18d service nova] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:48 user nova-compute[75288]: DEBUG nova.compute.manager [req-a26f61ae-622d-4971-bb10-d74b2a9fc89a req-f9d88260-8584-43d1-9445-65e2d12fc18d service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] No waiting events found dispatching network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:18:48 user nova-compute[75288]: WARNING nova.compute.manager [req-a26f61ae-622d-4971-bb10-d74b2a9fc89a req-f9d88260-8584-43d1-9445-65e2d12fc18d service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received unexpected event network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 for instance with vm_state building and task_state spawning.
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-d53616c1-fce3-43d5-b431-e63eec4cb13b req-fcb81318-536d-4d57-9974-2437b76000f4 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.compute.manager [req-d53616c1-fce3-43d5-b431-e63eec4cb13b req-fcb81318-536d-4d57-9974-2437b76000f4 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing instance network info cache due to event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d53616c1-fce3-43d5-b431-e63eec4cb13b req-fcb81318-536d-4d57-9974-2437b76000f4 service nova] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d53616c1-fce3-43d5-b431-e63eec4cb13b req-fcb81318-536d-4d57-9974-2437b76000f4 service nova] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-d53616c1-fce3-43d5-b431-e63eec4cb13b req-fcb81318-536d-4d57-9974-2437b76000f4 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-d53616c1-fce3-43d5-b431-e63eec4cb13b req-fcb81318-536d-4d57-9974-2437b76000f4 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updated VIF entry in instance network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.network.neutron [req-d53616c1-fce3-43d5-b431-e63eec4cb13b req-fcb81318-536d-4d57-9974-2437b76000f4 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-d53616c1-fce3-43d5-b431-e63eec4cb13b req-fcb81318-536d-4d57-9974-2437b76000f4 service nova] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:49 user nova-compute[75288]: INFO nova.compute.manager [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Detaching volume 3890aeca-41b2-49b2-bbd4-9122402efa4f
Dec 01 14:18:49 user nova-compute[75288]: INFO nova.virt.block_device [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Attempting to driver detach volume 3890aeca-41b2-49b2-bbd4-9122402efa4f from mountpoint /dev/vdb
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Attempting to detach device vdb from instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:18:49 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:18:49 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:18:49 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:18:49 user nova-compute[75288]:   <serial>3890aeca-41b2-49b2-bbd4-9122402efa4f</serial>
Dec 01 14:18:49 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:18:49 user nova-compute[75288]: </disk>
Dec 01 14:18:49 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:18:49 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully detached device vdb from instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 from the persistent domain config.
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:18:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:18:49 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:18:49 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:18:49 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:18:49 user nova-compute[75288]:   <serial>3890aeca-41b2-49b2-bbd4-9122402efa4f</serial>
Dec 01 14:18:49 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:18:49 user nova-compute[75288]: </disk>
Dec 01 14:18:49 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:18:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Instance spawned successfully.
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Found default for hw_cdrom_bus of ide {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Found default for hw_disk_bus of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Found default for hw_input_bus of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Found default for hw_pointer_model of None {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Found default for hw_video_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Found default for hw_vif_model of virtio {{(pid=75288) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 14:18:50 user nova-compute[75288]: INFO nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Took 5.59 seconds to spawn the instance on the hypervisor.
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-9475321d-3b32-4dcc-bf91-fe7bbc14751d req-027f0369-1e40-458b-b210-7d1ce9508ad5 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received event network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9475321d-3b32-4dcc-bf91-fe7bbc14751d req-027f0369-1e40-458b-b210-7d1ce9508ad5 service nova] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9475321d-3b32-4dcc-bf91-fe7bbc14751d req-027f0369-1e40-458b-b210-7d1ce9508ad5 service nova] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-9475321d-3b32-4dcc-bf91-fe7bbc14751d req-027f0369-1e40-458b-b210-7d1ce9508ad5 service nova] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:50 user nova-compute[75288]: DEBUG nova.compute.manager [req-9475321d-3b32-4dcc-bf91-fe7bbc14751d req-027f0369-1e40-458b-b210-7d1ce9508ad5 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] No waiting events found dispatching network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:18:50 user nova-compute[75288]: WARNING nova.compute.manager [req-9475321d-3b32-4dcc-bf91-fe7bbc14751d req-027f0369-1e40-458b-b210-7d1ce9508ad5 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received unexpected event network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 for instance with vm_state building and task_state spawning.
Dec 01 14:18:50 user nova-compute[75288]: INFO nova.compute.manager [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Took 6.30 seconds to build instance.
Dec 01 14:18:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-314a206d-777e-4d2c-9ccf-5e43b7a8a248 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.397s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-e77a06ac-856f-41fd-b879-d8c956573d65 req-e6ae7c21-ff83-482b-8086-128a23494437 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:18:51 user nova-compute[75288]: DEBUG nova.compute.manager [req-e77a06ac-856f-41fd-b879-d8c956573d65 req-e6ae7c21-ff83-482b-8086-128a23494437 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing instance network info cache due to event network-changed-01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:18:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e77a06ac-856f-41fd-b879-d8c956573d65 req-e6ae7c21-ff83-482b-8086-128a23494437 service nova] Acquiring lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:18:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e77a06ac-856f-41fd-b879-d8c956573d65 req-e6ae7c21-ff83-482b-8086-128a23494437 service nova] Acquired lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:18:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-e77a06ac-856f-41fd-b879-d8c956573d65 req-e6ae7c21-ff83-482b-8086-128a23494437 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Refreshing network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:18:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-e77a06ac-856f-41fd-b879-d8c956573d65 req-e6ae7c21-ff83-482b-8086-128a23494437 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updated VIF entry in instance network info cache for port 01aa5dda-3f60-49b5-aaca-418833fea664. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:18:51 user nova-compute[75288]: DEBUG nova.network.neutron [req-e77a06ac-856f-41fd-b879-d8c956573d65 req-e6ae7c21-ff83-482b-8086-128a23494437 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [{"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:18:51 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-e77a06ac-856f-41fd-b879-d8c956573d65 req-e6ae7c21-ff83-482b-8086-128a23494437 service nova] Releasing lock "refresh_cache-42eb4684-79a0-4ff3-92b4-e364a39b96b7" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:18:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Verify base images {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Image id 5960f30f-79c5-4c7d-9bd0-41d5142b4539 yields fingerprint e623cb687103a093ee52879bc3a63ccf66a4f57a {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] image 5960f30f-79c5-4c7d-9bd0-41d5142b4539 at (/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a): checking
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] image 5960f30f-79c5-4c7d-9bd0-41d5142b4539 at (/opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a): image is in use {{(pid=75288) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Image id e1295c1f-d1d8-43db-8aef-8b1c40374767 yields fingerprint 2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] image e1295c1f-d1d8-43db-8aef-8b1c40374767 at (/opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be): checking
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] image e1295c1f-d1d8-43db-8aef-8b1c40374767 at (/opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be): image is in use {{(pid=75288) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 is a valid instance name {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] 14ab8b13-2168-4bc6-b9d5-337a4e54a50f is a valid instance name {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] 14ab8b13-2168-4bc6-b9d5-337a4e54a50f has a disk file {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f is backed by e623cb687103a093ee52879bc3a63ccf66a4f57a {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] 42eb4684-79a0-4ff3-92b4-e364a39b96b7 is a valid instance name {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] 42eb4684-79a0-4ff3-92b4-e364a39b96b7 has a disk file {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 is backed by 2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be {{(pid=75288) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 01 14:18:57 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9
Dec 01 14:18:57 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3
Dec 01 14:18:57 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee
Dec 01 14:18:57 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387
Dec 01 14:18:57 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839
Dec 01 14:18:57 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f
Dec 01 14:18:57 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f
Dec 01 14:18:57 user nova-compute[75288]: WARNING nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Unknown base file: /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Active base files: /opt/stack/data/nova/instances/_base/e623cb687103a093ee52879bc3a63ccf66a4f57a /opt/stack/data/nova/instances/_base/2778e9aef1f5e50a05e8abd5d8ec8dd8ad64d9be
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Removable base files: /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9 /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3 /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387 /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839 /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fda2c37c3ae9209732d533344b2a8a09f10742e9
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/64aa8831e9634510036a7c7461bd3c0e1abd3de3
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bb57b0fbf6c4e4381f9eb5c7069f4c803d59d5ee
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1322aba760fc4efc26e2684fb8bef1b99a2c7387
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b4d08e4f31533726629511ac63ebfd458b422839
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/344bd39bb8bb9ef94493e15fa66b20a4f721768f
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9684f20df0ab71bccdca89e09e5005b9c3b2c35f
Dec 01 14:18:57 user nova-compute[75288]: INFO nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/093f1a9396a6e343c2812115aed30b027c6a6163
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Verification complete {{(pid=75288) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Verify swap images {{(pid=75288) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 01 14:18:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.imagecache [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Verify ephemeral images {{(pid=75288) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 01 14:19:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:19:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:10 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 is timed out.
Dec 01 14:19:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully detached device vdb from instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 from the live domain config.
Dec 01 14:19:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUsRzgHM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:19:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a85007b-9b3d-43b8-bb89-7b20993313a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:19:10 user nova-compute[75288]: No targets found.
Dec 01 14:19:10 user nova-compute[75288]: iSNS:
Dec 01 14:19:10 user nova-compute[75288]: No targets found.
Dec 01 14:19:10 user nova-compute[75288]: STATIC:
Dec 01 14:19:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b
Dec 01 14:19:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:19:10 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:19:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f
Dec 01 14:19:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:19:10 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:19:10 user nova-compute[75288]: FIRMWARE:
Dec 01 14:19:10 user nova-compute[75288]: No targets found.
Dec 01 14:19:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:19:10 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:19:10 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[908c11cd-37bb-4b3c-9402-3a88ecf5588d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5350a9-4815-4123-b7f0-beeb6e0f3269]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:19:10 user nova-compute[75288]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:19:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f (non-flash)
Dec 01 14:19:10 user nova-compute[75288]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:19:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc7bfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d837c9-8bab-4569-93f1-ddbc54f5faca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[046287b3-5d1f-4c40-aea2-9f53edb4279c]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a170d-bc91-419d-a059-5d39db49a05e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[72da8c10-1d48-46e3-b8c6-0153ca58f3f3]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3744f3-c8d9-487d-8861-c2b3df331a8a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[245dcdf6-5bb8-42d2-a2ef-bbcd81c7b7ea]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f, portal: 172.16.0.220,3260]
Dec 01 14:19:10 user nova-compute[75288]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f, portal: 172.16.0.220,3260] successful.
Dec 01 14:19:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3890aeca-41b2-49b2-bbd4-9122402efa4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de52764-98b1-4997-815b-e27887864047]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] <== disconnect_volume: return (316ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:19:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:19:11 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'flavor' on Instance uuid 42eb4684-79a0-4ff3-92b4-e364a39b96b7 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:19:11 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d0025a35-bb91-4249-b448-057ca8c4a658 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-243de1c9-97e6-4182-bcd8-21f744be607f req-1682b671-d141-420d-9904-12a142ca3541 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-243de1c9-97e6-4182-bcd8-21f744be607f req-1682b671-d141-420d-9904-12a142ca3541 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing instance network info cache due to event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-243de1c9-97e6-4182-bcd8-21f744be607f req-1682b671-d141-420d-9904-12a142ca3541 service nova] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-243de1c9-97e6-4182-bcd8-21f744be607f req-1682b671-d141-420d-9904-12a142ca3541 service nova] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-243de1c9-97e6-4182-bcd8-21f744be607f req-1682b671-d141-420d-9904-12a142ca3541 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-243de1c9-97e6-4182-bcd8-21f744be607f req-1682b671-d141-420d-9904-12a142ca3541 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updated VIF entry in instance network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG nova.network.neutron [req-243de1c9-97e6-4182-bcd8-21f744be607f req-1682b671-d141-420d-9904-12a142ca3541 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-243de1c9-97e6-4182-bcd8-21f744be607f req-1682b671-d141-420d-9904-12a142ca3541 service nova] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:13 user nova-compute[75288]: INFO nova.compute.manager [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Shelve offloading
Dec 01 14:19:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-efe9adc7-0f7e-4587-83fb-08b6ba4b8d61 req-c8874351-f132-41b1-a3fc-8acff3670d43 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-unplugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-efe9adc7-0f7e-4587-83fb-08b6ba4b8d61 req-c8874351-f132-41b1-a3fc-8acff3670d43 service nova] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-efe9adc7-0f7e-4587-83fb-08b6ba4b8d61 req-c8874351-f132-41b1-a3fc-8acff3670d43 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-efe9adc7-0f7e-4587-83fb-08b6ba4b8d61 req-c8874351-f132-41b1-a3fc-8acff3670d43 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:13 user nova-compute[75288]: DEBUG nova.compute.manager [req-efe9adc7-0f7e-4587-83fb-08b6ba4b8d61 req-c8874351-f132-41b1-a3fc-8acff3670d43 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] No waiting events found dispatching network-vif-unplugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:19:13 user nova-compute[75288]: WARNING nova.compute.manager [req-efe9adc7-0f7e-4587-83fb-08b6ba4b8d61 req-c8874351-f132-41b1-a3fc-8acff3670d43 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received unexpected event network-vif-unplugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 for instance with vm_state active and task_state shelving.
Dec 01 14:19:14 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance destroyed successfully.
Dec 01 14:19:14 user nova-compute[75288]: DEBUG nova.compute.manager [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:19:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:19:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:19:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:19:14 user nova-compute[75288]: DEBUG nova.network.neutron [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:19:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:19:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance destroyed successfully.
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lazy-loading 'resources' on Instance uuid 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-191619064',display_name='tempest-TestShelveInstance-server-191619064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-191619064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaTfWqFnScfDQvc1iGBKh7J9lY1UZczsoJeq95eSWXbM+O9s/k/RlP113Er93a2KBe7P8P/gG5zTmrn6ikETkZvKarDBTU1lO7zmH2LVcr12lslMObr4WQn5C4zKcFJqw==',key_name='tempest-TestShelveInstance-2098869375',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14db84cd86654aad9f8564d909447c62',ramdisk_id='',reservation_id='r-rkq5nofm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-599310837',owner_user_name='tempest-TestShelveInstance-599310837-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:17:40Z,user_data=None,user_id='67d2e20a449a40a7af858040cd775587',uuid=0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converting VIF {"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_vif [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb02f0ed-89, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cbefeab-9830-40d4-895f-49b79d81076e) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:15 user nova-compute[75288]: INFO os_vif [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89')
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJeCkZUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:19:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9871c5-75e6-4576-bccd-6b4f00fb681e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:19:15 user nova-compute[75288]: No targets found.
Dec 01 14:19:15 user nova-compute[75288]: iSNS:
Dec 01 14:19:15 user nova-compute[75288]: No targets found.
Dec 01 14:19:15 user nova-compute[75288]: STATIC:
Dec 01 14:19:15 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b
Dec 01 14:19:15 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:19:15 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:19:15 user nova-compute[75288]: FIRMWARE:
Dec 01 14:19:15 user nova-compute[75288]: No targets found.
Dec 01 14:19:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:19:15 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:19:15 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bc0984-a309-48f3-8828-00e8185cb557]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13de560-90ee-4496-87de-8e28192aba0a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:19:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:19:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc7bf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b'): ({'sdc'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Removing single pathed devices sdc {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de35ecb-77c8-4f58-816f-db25fd9d2400]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d433c1-7a39-4366-8ed8-f5ebc1970ac8]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Flushing IO for device /dev/sdc {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8225064b-c063-41b5-9f6b-21cd669f49cc]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c87389-5ee5-44aa-8adb-507671e59a65]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] SCSI volumes sdc have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d740a0-9428-456e-9fa1-7fb2677dcef8]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d91130-7b74-42c8-9cec-9296ada89a98]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260]
Dec 01 14:19:15 user nova-compute[75288]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260] successful.
Dec 01 14:19:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40da405-2027-4c99-863b-de5530192c74]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] <== disconnect_volume: return (283ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:19:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Deleting instance files /opt/stack/data/nova/instances/0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3_del
Dec 01 14:19:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Deletion of /opt/stack/data/nova/instances/0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3_del complete
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] No waiting events found dispatching network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:19:15 user nova-compute[75288]: WARNING nova.compute.manager [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received unexpected event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 for instance with vm_state active and task_state shelving.
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing instance network info cache due to event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:19:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG nova.network.neutron [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updated VIF entry in instance network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG nova.network.neutron [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": null, "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1ceb7ebb-c330-4128-adbe-91a84574a65b req-7b358b51-359e-4bd9-9d31-d0514aa34938 service nova] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:19:16 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Deleted allocations for instance 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3
Dec 01 14:19:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG nova.objects.instance [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lazy-loading 'numa_topology' on Instance uuid 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG nova.objects.base [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Object Instance<0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3> lazy-loaded attributes: resources,numa_topology {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-f7035fd2-826b-4ab0-b7df-626d3d14cb3f tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.354s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:17 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:28 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:31 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:19:32 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:19:32 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:19:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=24.946083068847656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:19:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:19:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Dec 01 14:19:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 14:19:33 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:33 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 14:19:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:19:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:19:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:44 user nova-compute[75288]: INFO nova.compute.manager [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Terminating instance
Dec 01 14:19:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-031534b9-35c2-4b0d-ae58-f1b13467d752 req-0bf6e525-8dbf-4d9c-bf4c-575f1b4e4055 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-unplugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-031534b9-35c2-4b0d-ae58-f1b13467d752 req-0bf6e525-8dbf-4d9c-bf4c-575f1b4e4055 service nova] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-031534b9-35c2-4b0d-ae58-f1b13467d752 req-0bf6e525-8dbf-4d9c-bf4c-575f1b4e4055 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-031534b9-35c2-4b0d-ae58-f1b13467d752 req-0bf6e525-8dbf-4d9c-bf4c-575f1b4e4055 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-031534b9-35c2-4b0d-ae58-f1b13467d752 req-0bf6e525-8dbf-4d9c-bf4c-575f1b4e4055 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] No waiting events found dispatching network-vif-unplugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:19:44 user nova-compute[75288]: DEBUG nova.compute.manager [req-031534b9-35c2-4b0d-ae58-f1b13467d752 req-0bf6e525-8dbf-4d9c-bf4c-575f1b4e4055 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-unplugged-01aa5dda-3f60-49b5-aaca-418833fea664 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:19:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Instance destroyed successfully.
Dec 01 14:19:45 user nova-compute[75288]: DEBUG nova.objects.instance [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lazy-loading 'resources' on Instance uuid 42eb4684-79a0-4ff3-92b4-e364a39b96b7 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1101455580',display_name='tempest-TestMinimumBasicScenario-server-1101455580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1101455580',id=48,image_ref='e1295c1f-d1d8-43db-8aef-8b1c40374767',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMahwg2uxin1r1kx6Jp6FwHMonLCVKjiu4AlqIGxsy+2i7EHT1MTlMIUuWsEe8POfwDA33q1JrUMqzg6U/P2AF+TaeODv+2jMcmlAxl1bu4zUsI07Fegr3f95Wd9thDTjw==',key_name='tempest-TestMinimumBasicScenario-480209938',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fae7777bb784a55b159c88bc38e4fe9',ramdisk_id='',reservation_id='r-ah77t449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1295c1f-d1d8-43db-8aef-8b1c40374767',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-652077982',owner_user_name='tempest-TestMinimumBasicScenario-652077982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:17:05Z,user_data=None,user_id='02f74cb0fb13418b894e8517317bea9e',uuid=42eb4684-79a0-4ff3-92b4-e364a39b96b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converting VIF {"id": "01aa5dda-3f60-49b5-aaca-418833fea664", "address": "fa:16:3e:8e:d1:ae", "network": {"id": "34933ae8-05f2-4070-b67c-288ea6f1768a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1779063258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fae7777bb784a55b159c88bc38e4fe9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01aa5dda-3f", "ovs_interfaceid": "01aa5dda-3f60-49b5-aaca-418833fea664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=01aa5dda-3f60-49b5-aaca-418833fea664,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa5dda-3f') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG os_vif [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=01aa5dda-3f60-49b5-aaca-418833fea664,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa5dda-3f') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01aa5dda-3f, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb4500aa-46f8-4452-8122-7c534bc35b1d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:45 user nova-compute[75288]: INFO os_vif [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:d1:ae,bridge_name='br-int',has_traffic_filtering=True,id=01aa5dda-3f60-49b5-aaca-418833fea664,network=Network(34933ae8-05f2-4070-b67c-288ea6f1768a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01aa5dda-3f')
Dec 01 14:19:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Deleting instance files /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7_del
Dec 01 14:19:45 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Deletion of /opt/stack/data/nova/instances/42eb4684-79a0-4ff3-92b4-e364a39b96b7_del complete
Dec 01 14:19:45 user nova-compute[75288]: INFO nova.compute.manager [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Took 1.00 seconds to destroy the instance on the hypervisor.
Dec 01 14:19:45 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:19:45 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:19:46 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:19:46 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Took 0.58 seconds to deallocate network for instance.
Dec 01 14:19:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:46 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:19:46 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:19:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:46 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Deleted allocations for instance 42eb4684-79a0-4ff3-92b4-e364a39b96b7
Dec 01 14:19:46 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-d8e57ebc-a3d3-412f-a420-ae47c781bbb2 tempest-TestMinimumBasicScenario-652077982 tempest-TestMinimumBasicScenario-652077982-project-member] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eae5a9b-5285-4446-b29c-48af1de0efe6 req-1c6c26ab-94e1-4e14-b65b-590411a7c803 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eae5a9b-5285-4446-b29c-48af1de0efe6 req-1c6c26ab-94e1-4e14-b65b-590411a7c803 service nova] Acquiring lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eae5a9b-5285-4446-b29c-48af1de0efe6 req-1c6c26ab-94e1-4e14-b65b-590411a7c803 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:19:47 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-6eae5a9b-5285-4446-b29c-48af1de0efe6 req-1c6c26ab-94e1-4e14-b65b-590411a7c803 service nova] Lock "42eb4684-79a0-4ff3-92b4-e364a39b96b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:19:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eae5a9b-5285-4446-b29c-48af1de0efe6 req-1c6c26ab-94e1-4e14-b65b-590411a7c803 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] No waiting events found dispatching network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:19:47 user nova-compute[75288]: WARNING nova.compute.manager [req-6eae5a9b-5285-4446-b29c-48af1de0efe6 req-1c6c26ab-94e1-4e14-b65b-590411a7c803 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received unexpected event network-vif-plugged-01aa5dda-3f60-49b5-aaca-418833fea664 for instance with vm_state deleted and task_state None.
Dec 01 14:19:47 user nova-compute[75288]: DEBUG nova.compute.manager [req-6eae5a9b-5285-4446-b29c-48af1de0efe6 req-1c6c26ab-94e1-4e14-b65b-590411a7c803 service nova] [instance: 42eb4684-79a0-4ff3-92b4-e364a39b96b7] Received event network-vif-deleted-01aa5dda-3f60-49b5-aaca-418833fea664 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:19:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:19:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:20:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:20:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:20:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:06 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 14:20:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 14:20:06 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance has had 5 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Dec 01 14:20:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:20:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:20:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:20:20 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:25 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:30 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:32 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:20:33 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8879MB free_disk=24.97335433959961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing inventories for resource provider 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating ProviderTree inventory for provider 6546d821-2196-4219-8f98-fc64fd991628 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Updating inventory in ProviderTree for provider 6546d821-2196-4219-8f98-fc64fd991628 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing aggregate associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, aggregates: None {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Refreshing trait associations for resource provider 6546d821-2196-4219-8f98-fc64fd991628, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75288) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:20:33 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:20:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:20:34 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:20:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:20:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:20:34 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:20:34 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updating instance_info_cache with network_info: [{"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-fea4fae9-0327-4ebb-abc2-e4052d589a92 req-5fee56ce-420c-4241-97ae-0c9eb3c2fd4f service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received event network-changed-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG nova.compute.manager [req-fea4fae9-0327-4ebb-abc2-e4052d589a92 req-5fee56ce-420c-4241-97ae-0c9eb3c2fd4f service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Refreshing instance network info cache due to event network-changed-e19d6b06-b434-46ab-bf6a-520de7f76c87. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fea4fae9-0327-4ebb-abc2-e4052d589a92 req-5fee56ce-420c-4241-97ae-0c9eb3c2fd4f service nova] Acquiring lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fea4fae9-0327-4ebb-abc2-e4052d589a92 req-5fee56ce-420c-4241-97ae-0c9eb3c2fd4f service nova] Acquired lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-fea4fae9-0327-4ebb-abc2-e4052d589a92 req-5fee56ce-420c-4241-97ae-0c9eb3c2fd4f service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Refreshing network info cache for port e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-fea4fae9-0327-4ebb-abc2-e4052d589a92 req-5fee56ce-420c-4241-97ae-0c9eb3c2fd4f service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updated VIF entry in instance network info cache for port e19d6b06-b434-46ab-bf6a-520de7f76c87. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG nova.network.neutron [req-fea4fae9-0327-4ebb-abc2-e4052d589a92 req-5fee56ce-420c-4241-97ae-0c9eb3c2fd4f service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updating instance_info_cache with network_info: [{"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:20:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-fea4fae9-0327-4ebb-abc2-e4052d589a92 req-5fee56ce-420c-4241-97ae-0c9eb3c2fd4f service nova] Releasing lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:20:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG nova.objects.instance [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:20:39 user nova-compute[75288]: INFO nova.compute.manager [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Attaching volume 33677af7-4330-4e91-afab-7cec5d254a33 to /dev/vdb
Dec 01 14:20:39 user nova-compute[75288]: DEBUG os_brick.utils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c961ee7-0bab-498e-a0de-b81aa927c0fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ce231-4e4d-4db9-a486-54b0eadc1553]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856b755-6ce9-439a-9bf3-c348a858cb01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3034c5-2404-4f48-916d-c0ba6a098342]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:20:39 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:20:39 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8a6f2d-50df-458c-81c8-3d6653ac99c3]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG os_brick.utils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:20:39 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updating existing volume attachment record: e21f1292-69f6-460a-8736-1eafee1bf8b9 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:20:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:20:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:20:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:45 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDhgbrIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:20:47 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:20:47 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:20:47 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6ed50-cb6b-48ca-8301-4b604a2af572]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:20:47 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40ec357-4d11-41bc-88e5-79c45e9eceb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33] added
Dec 01 14:20:47 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f34c6-bf18-40df-bec9-29653fba852e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[91626b2a-edde-4c20-b982-272ff02d902b]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDhgbrIa {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDhgbrIa" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff86d8e-e342-43d5-8edc-d4bfcfb96bd4]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:47 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jDhgbrIa'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a680e01-1ec1-449a-8787-3ffc495f5e58]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5328c99a-63be-43f3-959d-e238c218225c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:20:48 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:20:48 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:20:48 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 14:20:48 user nova-compute[75288]: 
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d2431f-f279-4fe9-a194-9c6c2b3835b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33, portal: 172.16.0.220,3260]
Dec 01 14:20:48 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33, portal: 172.16.0.220,3260] successful.
Dec 01 14:20:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba5895f-66ff-4d3a-83a6-55295f35f1da]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2499ef-3b3d-49d4-960c-fa75a08c14f9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 (non-flash)
Dec 01 14:20:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 (non-flash)
Dec 01 14:20:48 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[da905632-e1b9-41ee-b3bb-7883f2937577]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:20:48 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDhgbrIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23031626638336630', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031626638336630', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG nova.objects.instance [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 14:20:49 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:20:49 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:20:49 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:20:49 user nova-compute[75288]:   <serial>33677af7-4330-4e91-afab-7cec5d254a33</serial>
Dec 01 14:20:49 user nova-compute[75288]: </disk>
Dec 01 14:20:49 user nova-compute[75288]:  {{(pid=75288) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] No VIF found with MAC fa:16:3e:35:b1:e0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:20:49 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-dff31f52-c2f0-47e4-8e60-23e491cbffbd tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.377s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:20:50 user nova-compute[75288]: INFO nova.compute.manager [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Detaching volume 33677af7-4330-4e91-afab-7cec5d254a33
Dec 01 14:20:50 user nova-compute[75288]: INFO nova.virt.block_device [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Attempting to driver detach volume 33677af7-4330-4e91-afab-7cec5d254a33 from mountpoint /dev/vdb
Dec 01 14:20:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Attempting to detach device vdb from instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f from the persistent domain config. {{(pid=75288) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:20:50 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:20:50 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:20:50 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:20:50 user nova-compute[75288]:   <serial>33677af7-4330-4e91-afab-7cec5d254a33</serial>
Dec 01 14:20:50 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:20:50 user nova-compute[75288]: </disk>
Dec 01 14:20:50 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:20:50 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully detached device vdb from instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f from the persistent domain config.
Dec 01 14:20:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f from the live domain config. {{(pid=75288) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.guest [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 14:20:50 user nova-compute[75288]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:20:50 user nova-compute[75288]:   <source dev="/dev/sdb"/>
Dec 01 14:20:50 user nova-compute[75288]:   <target dev="vdb" bus="virtio"/>
Dec 01 14:20:50 user nova-compute[75288]:   <serial>33677af7-4330-4e91-afab-7cec5d254a33</serial>
Dec 01 14:20:50 user nova-compute[75288]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 14:20:50 user nova-compute[75288]: </disk>
Dec 01 14:20:50 user nova-compute[75288]:  {{(pid=75288) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:50 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 14:20:53 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:20:55 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:00 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:02 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:02 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Triggering sync for uuid 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 14:21:02 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:05 user nova-compute[75288]: INFO nova.compute.manager [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Unshelving
Dec 01 14:21:05 user nova-compute[75288]: INFO nova.virt.block_device [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Booting with volume 6bb2c872-8a6f-42b4-b454-e05de63d990b at /dev/vda
Dec 01 14:21:05 user nova-compute[75288]: DEBUG os_brick.utils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2994371-52c3-46bb-8381-bbe8345e5a21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d7ddcb98ba1d\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[363929ed-816a-4cd3-99b5-e70425f1ed71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c29996-56df-484f-9b57-c5666c0e5fa3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45e2d18-7ef4-497f-af4c-0d433b46debe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Running cmd (subprocess): nvme version {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] 'nvme version' failed. Not Retrying. {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] nvme not present on system {{(pid=75288) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 14:21:05 user nova-compute[75288]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 14:21:05 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc50c763-e834-481c-819b-119d98dd3815]: (4, '') {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75288) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.lightos [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] LIGHTOS: no hostnqn found. {{(pid=75288) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG os_brick.utils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d7ddcb98ba1d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:21:05 user nova-compute[75288]: DEBUG nova.virt.block_device [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating existing volume attachment record: e82f21e4-4a05-4023-b41d-7b4cf4f0f2e0 {{(pid=75288) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 14:21:08 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:10 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f is timed out.
Dec 01 14:21:10 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully detached device vdb from instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f from the live domain config.
Dec 01 14:21:10 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDhgbrIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:21:10 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:21:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd9a913-52c0-4e84-94a5-9b8f8747ef65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:21:10 user nova-compute[75288]: No targets found.
Dec 01 14:21:10 user nova-compute[75288]: iSNS:
Dec 01 14:21:10 user nova-compute[75288]: No targets found.
Dec 01 14:21:10 user nova-compute[75288]: STATIC:
Dec 01 14:21:10 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33
Dec 01 14:21:10 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:21:10 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:21:10 user nova-compute[75288]: FIRMWARE:
Dec 01 14:21:10 user nova-compute[75288]: No targets found.
Dec 01 14:21:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:21:10 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:21:10 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc80541-df95-4c20-b9d6-ff5510ff6497]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[b653fb3f-7727-4289-a68f-cbb2d5cdaf50]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 (non-flash)
Dec 01 14:21:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:21:10 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 (non-flash)
Dec 01 14:21:10 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdbbc3eb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b186e1-144e-43b6-bd09-6449117e1490]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[9402aaad-704e-4bfc-b6e7-804c146281d3]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[488317cc-c845-42b1-9004-dfd0cb6933aa]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b2ddfb-7ef3-4970-b194-ab9445753574]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae3cd7e-c5e8-4f66-9f8f-8d6eb09d4093]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e74cfd-d29c-4e99-9bf2-b4245bed2d95]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33, portal: 172.16.0.220,3260]
Dec 01 14:21:11 user nova-compute[75288]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33, portal: 172.16.0.220,3260] successful.
Dec 01 14:21:11 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33677af7-4330-4e91-afab-7cec5d254a33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5790aad-6a66-492a-946b-4d2874b588da]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] <== disconnect_volume: return (294ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:21:11 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:21:12 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'flavor' on Instance uuid 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:21:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a516e93b-0cbe-48c8-9516-7b0416f992f2 tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.671s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.576s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:12 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lazy-loading 'pci_requests' on Instance uuid 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:21:14 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lazy-loading 'numa_topology' on Instance uuid 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:21:14 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75288) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 14:21:14 user nova-compute[75288]: INFO nova.compute.claims [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Claim successful on node user
Dec 01 14:21:14 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:21:14 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:21:14 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:14 user nova-compute[75288]: INFO nova.network.neutron [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 14:21:14 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Building network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8401c74f-9289-4246-b4b5-f83f22405252 req-a9d64207-4be2-482b-be88-463ad5b4acc2 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.compute.manager [req-8401c74f-9289-4246-b4b5-f83f22405252 req-a9d64207-4be2-482b-be88-463ad5b4acc2 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing instance network info cache due to event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8401c74f-9289-4246-b4b5-f83f22405252 req-a9d64207-4be2-482b-be88-463ad5b4acc2 service nova] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.network.neutron [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Creating instance directory {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 14:21:15 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Creating image(s)
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Did not create local disks {{(pid=75288) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Ensure instance console log exists: /opt/stack/data/nova/instances/0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3/console.log {{(pid=75288) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Start _get_guest_xml network_info=[{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e82f21e4-4a05-4023-b41d-7b4cf4f0f2e0', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJeCkZUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3', 'attached_at': '', 'detached_at': '', 'volume_id': '6bb2c872-8a6f-42b4-b454-e05de63d990b', 'serial': '6bb2c872-8a6f-42b4-b454-e05de63d990b'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8401c74f-9289-4246-b4b5-f83f22405252 req-a9d64207-4be2-482b-be88-463ad5b4acc2 service nova] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.network.neutron [req-8401c74f-9289-4246-b4b5-f83f22405252 req-a9d64207-4be2-482b-be88-463ad5b4acc2 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:21:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:21:15 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] CPU controller missing on host. {{(pid=75288) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.host [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] CPU controller found on host. {{(pid=75288) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75288) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T13:39:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Flavor limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Image limits 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Flavor pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Image pref 0:0:0 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Got 1 possible topologies {{(pid=75288) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.hardware [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75288) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.objects.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Object Instance<0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Calling os-brick to attach iSCSI Volume {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJeCkZUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:21:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:21:15 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:21:15 user nova-compute[75288]: INFO os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8ae42d-6474-4141-9374-8ffdc081d999]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 14:21:15 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --interface default --op new {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd88a0f1-257c-40fa-a5a1-7515bc314b3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b] added\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b] added
Dec 01 14:21:15 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[905b849f-f9cb-40cc-9d50-4479189c347e]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd2d5e2-0b5b-4d5e-bfe5-99b8ad604341]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:15 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJeCkZUc {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJeCkZUc" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[192d5615-4f6e-43d2-9e0f-d88dc931f722]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJeCkZUc'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[506e26f7-7d97-44dd-94fc-6d6eb7263d17]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f0f368-c93e-400d-80ef-8d79d70d621b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:21:16 user nova-compute[75288]:  {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 14:21:16 user nova-compute[75288]:  {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:21:16 user nova-compute[75288]: WARNING os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 14:21:16 user nova-compute[75288]: 
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --login {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74d7cc8-26d1-4b27-b500-a9c7918f8f86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260]
Dec 01 14:21:16 user nova-compute[75288]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260] successful.
Dec 01 14:21:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee95117-3ef7-4cad-b98c-79fe9668b40a]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[7effe049-e5fa-479c-82da-efdd83a3fa65]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:21:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:21:16 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Connected to 172.16.0.220:3260 {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75288) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75288) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7a5000-d689-4883-8847-2050ca3ede05]: (4, ('- - 0', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG nova.network.neutron [req-8401c74f-9289-4246-b4b5-f83f22405252 req-a9d64207-4be2-482b-be88-463ad5b4acc2 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updated VIF entry in instance network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG nova.network.neutron [req-8401c74f-9289-4246-b4b5-f83f22405252 req-a9d64207-4be2-482b-be88-463ad5b4acc2 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:21:16 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8401c74f-9289-4246-b4b5-f83f22405252 req-a9d64207-4be2-482b-be88-463ad5b4acc2 service nova] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75288) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJeCkZUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75288) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23065636137616131', 'path': '/dev/sdb'} {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065636137616131', 'path': '/dev/sdb'} {{(pid=75288) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-191619064',display_name='tempest-TestShelveInstance-server-191619064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-191619064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2098869375',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='14db84cd86654aad9f8564d909447c62',ramdisk_id='',reservation_id='r-rkq5nofm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-599310837',owner_user_name='tempest-TestShelveInstance-599310837-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:21:05Z,user_data=None,user_id='67d2e20a449a40a7af858040cd775587',uuid=0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75288) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converting VIF {"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.objects.instance [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lazy-loading 'pci_devices' on Instance uuid 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.objects.base [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Object Instance<0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75288) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 14:21:17 user nova-compute[75288]:   <uuid>0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3</uuid>
Dec 01 14:21:17 user nova-compute[75288]:   <name>instance-00000032</name>
Dec 01 14:21:17 user nova-compute[75288]:   <memory>524288</memory>
Dec 01 14:21:17 user nova-compute[75288]:   <vcpu>1</vcpu>
Dec 01 14:21:17 user nova-compute[75288]:   <metadata>
Dec 01 14:21:17 user nova-compute[75288]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 14:21:17 user nova-compute[75288]:       <nova:package version="0.0.0"/>
Dec 01 14:21:17 user nova-compute[75288]:       <nova:name>tempest-TestShelveInstance-server-191619064</nova:name>
Dec 01 14:21:17 user nova-compute[75288]:       <nova:creationTime>2023-12-01 14:21:15</nova:creationTime>
Dec 01 14:21:17 user nova-compute[75288]:       <nova:flavor name="m1.tiny">
Dec 01 14:21:17 user nova-compute[75288]:         <nova:memory>512</nova:memory>
Dec 01 14:21:17 user nova-compute[75288]:         <nova:disk>1</nova:disk>
Dec 01 14:21:17 user nova-compute[75288]:         <nova:swap>0</nova:swap>
Dec 01 14:21:17 user nova-compute[75288]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 14:21:17 user nova-compute[75288]:         <nova:vcpus>1</nova:vcpus>
Dec 01 14:21:17 user nova-compute[75288]:       </nova:flavor>
Dec 01 14:21:17 user nova-compute[75288]:       <nova:owner>
Dec 01 14:21:17 user nova-compute[75288]:         <nova:user uuid="67d2e20a449a40a7af858040cd775587">tempest-TestShelveInstance-599310837-project-member</nova:user>
Dec 01 14:21:17 user nova-compute[75288]:         <nova:project uuid="14db84cd86654aad9f8564d909447c62">tempest-TestShelveInstance-599310837</nova:project>
Dec 01 14:21:17 user nova-compute[75288]:       </nova:owner>
Dec 01 14:21:17 user nova-compute[75288]:       <nova:ports>
Dec 01 14:21:17 user nova-compute[75288]:         <nova:port uuid="eb02f0ed-891c-4dfb-a17c-6b76d882c6f5">
Dec 01 14:21:17 user nova-compute[75288]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 14:21:17 user nova-compute[75288]:         </nova:port>
Dec 01 14:21:17 user nova-compute[75288]:       </nova:ports>
Dec 01 14:21:17 user nova-compute[75288]:     </nova:instance>
Dec 01 14:21:17 user nova-compute[75288]:   </metadata>
Dec 01 14:21:17 user nova-compute[75288]:   <sysinfo type="smbios">
Dec 01 14:21:17 user nova-compute[75288]:     <system>
Dec 01 14:21:17 user nova-compute[75288]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 14:21:17 user nova-compute[75288]:       <entry name="product">OpenStack Nova</entry>
Dec 01 14:21:17 user nova-compute[75288]:       <entry name="version">0.0.0</entry>
Dec 01 14:21:17 user nova-compute[75288]:       <entry name="serial">0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3</entry>
Dec 01 14:21:17 user nova-compute[75288]:       <entry name="uuid">0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3</entry>
Dec 01 14:21:17 user nova-compute[75288]:       <entry name="family">Virtual Machine</entry>
Dec 01 14:21:17 user nova-compute[75288]:     </system>
Dec 01 14:21:17 user nova-compute[75288]:   </sysinfo>
Dec 01 14:21:17 user nova-compute[75288]:   <os>
Dec 01 14:21:17 user nova-compute[75288]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 14:21:17 user nova-compute[75288]:     <boot dev="hd"/>
Dec 01 14:21:17 user nova-compute[75288]:     <smbios mode="sysinfo"/>
Dec 01 14:21:17 user nova-compute[75288]:   </os>
Dec 01 14:21:17 user nova-compute[75288]:   <features>
Dec 01 14:21:17 user nova-compute[75288]:     <acpi/>
Dec 01 14:21:17 user nova-compute[75288]:     <apic/>
Dec 01 14:21:17 user nova-compute[75288]:     <vmcoreinfo/>
Dec 01 14:21:17 user nova-compute[75288]:   </features>
Dec 01 14:21:17 user nova-compute[75288]:   <clock offset="utc">
Dec 01 14:21:17 user nova-compute[75288]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 14:21:17 user nova-compute[75288]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 14:21:17 user nova-compute[75288]:     <timer name="hpet" present="no"/>
Dec 01 14:21:17 user nova-compute[75288]:   </clock>
Dec 01 14:21:17 user nova-compute[75288]:   <cpu mode="custom" match="exact">
Dec 01 14:21:17 user nova-compute[75288]:     <model>Nehalem</model>
Dec 01 14:21:17 user nova-compute[75288]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 14:21:17 user nova-compute[75288]:   </cpu>
Dec 01 14:21:17 user nova-compute[75288]:   <devices>
Dec 01 14:21:17 user nova-compute[75288]:     <disk type="block" device="disk">
Dec 01 14:21:17 user nova-compute[75288]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 14:21:17 user nova-compute[75288]:       <source dev="/dev/sdb"/>
Dec 01 14:21:17 user nova-compute[75288]:       <target dev="vda" bus="virtio"/>
Dec 01 14:21:17 user nova-compute[75288]:       <serial>6bb2c872-8a6f-42b4-b454-e05de63d990b</serial>
Dec 01 14:21:17 user nova-compute[75288]:     </disk>
Dec 01 14:21:17 user nova-compute[75288]:     <interface type="ethernet">
Dec 01 14:21:17 user nova-compute[75288]:       <mac address="fa:16:3e:cd:4e:b0"/>
Dec 01 14:21:17 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:21:17 user nova-compute[75288]:       <mtu size="1442"/>
Dec 01 14:21:17 user nova-compute[75288]:       <target dev="tapeb02f0ed-89"/>
Dec 01 14:21:17 user nova-compute[75288]:     </interface>
Dec 01 14:21:17 user nova-compute[75288]:     <serial type="pty">
Dec 01 14:21:17 user nova-compute[75288]:       <log file="/opt/stack/data/nova/instances/0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3/console.log" append="off"/>
Dec 01 14:21:17 user nova-compute[75288]:     </serial>
Dec 01 14:21:17 user nova-compute[75288]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 14:21:17 user nova-compute[75288]:     <video>
Dec 01 14:21:17 user nova-compute[75288]:       <model type="virtio"/>
Dec 01 14:21:17 user nova-compute[75288]:     </video>
Dec 01 14:21:17 user nova-compute[75288]:     <rng model="virtio">
Dec 01 14:21:17 user nova-compute[75288]:       <backend model="random">/dev/urandom</backend>
Dec 01 14:21:17 user nova-compute[75288]:     </rng>
Dec 01 14:21:17 user nova-compute[75288]:     <controller type="usb" index="0" model="none"/>
Dec 01 14:21:17 user nova-compute[75288]:     <memballoon model="virtio">
Dec 01 14:21:17 user nova-compute[75288]:       <stats period="10"/>
Dec 01 14:21:17 user nova-compute[75288]:     </memballoon>
Dec 01 14:21:17 user nova-compute[75288]:   </devices>
Dec 01 14:21:17 user nova-compute[75288]: </domain>
Dec 01 14:21:17 user nova-compute[75288]:  {{(pid=75288) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-191619064',display_name='tempest-TestShelveInstance-server-191619064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-191619064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2098869375',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='14db84cd86654aad9f8564d909447c62',ramdisk_id='',reservation_id='r-rkq5nofm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-599310837',owner_user_name='tempest-TestShelveInstance-599310837-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:21:05Z,user_data=None,user_id='67d2e20a449a40a7af858040cd775587',uuid=0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converting VIF {"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG os_vif [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3653b154-3a8c-50da-a457-ce85233d7c7a', '_type': 'linux-noop'}}, row=False) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb02f0ed-89, may_exist=True, interface_attrs={}) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb02f0ed-89, col_values=(('qos', UUID('2ff80150-da15-43ff-8bdb-850a61f8393d')),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb02f0ed-89, col_values=(('external_ids', {'iface-id': 'eb02f0ed-891c-4dfb-a17c-6b76d882c6f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:4e:b0', 'vm-uuid': '0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3'}),), if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:17 user nova-compute[75288]: INFO os_vif [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89')
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] No BDM found with device name vda, not building metadata. {{(pid=75288) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 14:21:17 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] No VIF found with MAC fa:16:3e:cd:4e:b0, not building metadata {{(pid=75288) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-8893b89a-8dd7-4007-8eb3-ba5ba5fe0c57 req-8c221ec0-7168-47a7-a84b-0017d203779d service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8893b89a-8dd7-4007-8eb3-ba5ba5fe0c57 req-8c221ec0-7168-47a7-a84b-0017d203779d service nova] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8893b89a-8dd7-4007-8eb3-ba5ba5fe0c57 req-8c221ec0-7168-47a7-a84b-0017d203779d service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-8893b89a-8dd7-4007-8eb3-ba5ba5fe0c57 req-8c221ec0-7168-47a7-a84b-0017d203779d service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:18 user nova-compute[75288]: DEBUG nova.compute.manager [req-8893b89a-8dd7-4007-8eb3-ba5ba5fe0c57 req-8c221ec0-7168-47a7-a84b-0017d203779d service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] No waiting events found dispatching network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:21:18 user nova-compute[75288]: WARNING nova.compute.manager [req-8893b89a-8dd7-4007-8eb3-ba5ba5fe0c57 req-8c221ec0-7168-47a7-a84b-0017d203779d service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received unexpected event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 14:21:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:19 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance event wait completed in 0 seconds for  {{(pid=75288) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 14:21:20 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Guest created on hypervisor {{(pid=75288) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 14:21:20 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance spawned successfully.
Dec 01 14:21:20 user nova-compute[75288]: DEBUG nova.compute.manager [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Checking state {{(pid=75288) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 14:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-a7db314d-6963-4d04-b186-b3ec19af0e87 tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.389s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-72060760-4568-407e-b171-bae81124d323 req-ff9491c5-0683-41ec-bcd5-e1b5d836baed service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72060760-4568-407e-b171-bae81124d323 req-ff9491c5-0683-41ec-bcd5-e1b5d836baed service nova] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72060760-4568-407e-b171-bae81124d323 req-ff9491c5-0683-41ec-bcd5-e1b5d836baed service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:20 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-72060760-4568-407e-b171-bae81124d323 req-ff9491c5-0683-41ec-bcd5-e1b5d836baed service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:20 user nova-compute[75288]: DEBUG nova.compute.manager [req-72060760-4568-407e-b171-bae81124d323 req-ff9491c5-0683-41ec-bcd5-e1b5d836baed service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] No waiting events found dispatching network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:21:20 user nova-compute[75288]: WARNING nova.compute.manager [req-72060760-4568-407e-b171-bae81124d323 req-ff9491c5-0683-41ec-bcd5-e1b5d836baed service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received unexpected event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 for instance with vm_state active and task_state None.
Dec 01 14:21:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:23 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75288) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:21:34 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:21:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:21:35 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:21:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.010807037353516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:21:35 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:21:36 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:21:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:21:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:21:36 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:21:36 user nova-compute[75288]: DEBUG nova.objects.instance [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lazy-loading 'info_cache' on Instance uuid 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updating instance_info_cache with network_info: [{"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-14ab8b13-2168-4bc6-b9d5-337a4e54a50f" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:38 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:40 user nova-compute[75288]: INFO nova.compute.manager [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Terminating instance
Dec 01 14:21:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:40 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aa8be07-7f28-4c8e-87a3-320d4d41fac2 req-5a6d2980-3bde-460f-b60f-2571d6aaf013 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received event network-vif-unplugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aa8be07-7f28-4c8e-87a3-320d4d41fac2 req-5a6d2980-3bde-460f-b60f-2571d6aaf013 service nova] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aa8be07-7f28-4c8e-87a3-320d4d41fac2 req-5a6d2980-3bde-460f-b60f-2571d6aaf013 service nova] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-1aa8be07-7f28-4c8e-87a3-320d4d41fac2 req-5a6d2980-3bde-460f-b60f-2571d6aaf013 service nova] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aa8be07-7f28-4c8e-87a3-320d4d41fac2 req-5a6d2980-3bde-460f-b60f-2571d6aaf013 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] No waiting events found dispatching network-vif-unplugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.compute.manager [req-1aa8be07-7f28-4c8e-87a3-320d4d41fac2 req-5a6d2980-3bde-460f-b60f-2571d6aaf013 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received event network-vif-unplugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Instance destroyed successfully.
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.objects.instance [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lazy-loading 'resources' on Instance uuid 14ab8b13-2168-4bc6-b9d5-337a4e54a50f {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T14:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1376689677',display_name='tempest-AttachVolumeNegativeTest-server-1376689677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1376689677',id=51,image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYrI28a8gp0x3Xp36zeGA09sBAmqkPbak0V49wVmvDUu4fdWnwusXpKym6dv4Qo8UlndxhUErINmtzoDlWoxT6f4yuJWG9vXWom+yN2OiExoQy0THlEFLXjj7ovVwwyZA==',key_name='tempest-keypair-1340734752',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:18:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6739624adb2547748e727a851ee65689',ramdisk_id='',reservation_id='r-jod0zur0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5960f30f-79c5-4c7d-9bd0-41d5142b4539',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-566842019',owner_user_name='tempest-AttachVolumeNegativeTest-566842019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:18:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8674c9e9664e4122ae9966afdbebe365',uuid=14ab8b13-2168-4bc6-b9d5-337a4e54a50f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converting VIF {"id": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "address": "fa:16:3e:35:b1:e0", "network": {"id": "cf758a40-c128-4f66-a50f-77fbfa9acbcf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-784191674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6739624adb2547748e727a851ee65689", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape19d6b06-b4", "ovs_interfaceid": "e19d6b06-b434-46ab-bf6a-520de7f76c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=e19d6b06-b434-46ab-bf6a-520de7f76c87,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19d6b06-b4') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG os_vif [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=e19d6b06-b434-46ab-bf6a-520de7f76c87,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19d6b06-b4') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape19d6b06-b4, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33b250c0-1177-4e6d-86fd-246b44d693b9) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:21:41 user nova-compute[75288]: INFO os_vif [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:b1:e0,bridge_name='br-int',has_traffic_filtering=True,id=e19d6b06-b434-46ab-bf6a-520de7f76c87,network=Network(cf758a40-c128-4f66-a50f-77fbfa9acbcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape19d6b06-b4')
Dec 01 14:21:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Deleting instance files /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f_del
Dec 01 14:21:41 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Deletion of /opt/stack/data/nova/instances/14ab8b13-2168-4bc6-b9d5-337a4e54a50f_del complete
Dec 01 14:21:41 user nova-compute[75288]: INFO nova.compute.manager [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 01 14:21:41 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:21:41 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:21:42 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Took 0.71 seconds to deallocate network for instance.
Dec 01 14:21:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-6d2f2d4a-ddee-461f-a8fc-a7ba8023e285 req-21c7e687-edff-439e-b0cb-6c13cdacf137 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received event network-vif-deleted-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:21:42 user nova-compute[75288]: INFO nova.compute.manager [req-6d2f2d4a-ddee-461f-a8fc-a7ba8023e285 req-21c7e687-edff-439e-b0cb-6c13cdacf137 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Neutron deleted interface e19d6b06-b434-46ab-bf6a-520de7f76c87; detaching it from the instance and deleting it from the info cache
Dec 01 14:21:42 user nova-compute[75288]: DEBUG nova.network.neutron [req-6d2f2d4a-ddee-461f-a8fc-a7ba8023e285 req-21c7e687-edff-439e-b0cb-6c13cdacf137 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG nova.compute.manager [req-6d2f2d4a-ddee-461f-a8fc-a7ba8023e285 req-21c7e687-edff-439e-b0cb-6c13cdacf137 service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Detach interface failed, port_id=e19d6b06-b434-46ab-bf6a-520de7f76c87, reason: Instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f could not be found. {{(pid=75288) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:21:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:42 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Deleted allocations for instance 14ab8b13-2168-4bc6-b9d5-337a4e54a50f
Dec 01 14:21:42 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-29e7470b-eb16-490b-bddc-747acc3512db tempest-AttachVolumeNegativeTest-566842019 tempest-AttachVolumeNegativeTest-566842019-project-member] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-20f2faae-b828-4e70-a488-b1c34da14b3c req-27b37d90-59cd-4b42-ba85-eafc10f7be0b service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received event network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:21:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-20f2faae-b828-4e70-a488-b1c34da14b3c req-27b37d90-59cd-4b42-ba85-eafc10f7be0b service nova] Acquiring lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:21:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-20f2faae-b828-4e70-a488-b1c34da14b3c req-27b37d90-59cd-4b42-ba85-eafc10f7be0b service nova] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:21:43 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-20f2faae-b828-4e70-a488-b1c34da14b3c req-27b37d90-59cd-4b42-ba85-eafc10f7be0b service nova] Lock "14ab8b13-2168-4bc6-b9d5-337a4e54a50f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:21:43 user nova-compute[75288]: DEBUG nova.compute.manager [req-20f2faae-b828-4e70-a488-b1c34da14b3c req-27b37d90-59cd-4b42-ba85-eafc10f7be0b service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] No waiting events found dispatching network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:21:43 user nova-compute[75288]: WARNING nova.compute.manager [req-20f2faae-b828-4e70-a488-b1c34da14b3c req-27b37d90-59cd-4b42-ba85-eafc10f7be0b service nova] [instance: 14ab8b13-2168-4bc6-b9d5-337a4e54a50f] Received unexpected event network-vif-plugged-e19d6b06-b434-46ab-bf6a-520de7f76c87 for instance with vm_state deleted and task_state None.
Dec 01 14:21:43 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:47 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:21:48 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:21:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:22:01 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:06 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:11 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:22:16 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:22:21 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:26 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:22:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:31 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:35 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75288) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:22:36 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=25.03778076171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Instance 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75288) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:22:36 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:22:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:37 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:22:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:22:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:22:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Forcefully refreshing network info cache for instance {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 14:22:38 user nova-compute[75288]: DEBUG nova.network.neutron [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:22:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:22:38 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updated the network info_cache for instance {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 14:22:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:41 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:44 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:22:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:22:46 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:51 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:22:56 user nova-compute[75288]: INFO nova.compute.manager [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Terminating instance
Dec 01 14:22:56 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Start destroying the instance on the hypervisor. {{(pid=75288) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-b2f26f4d-c9b7-46ec-8bb0-9217d90c0066 req-5b028314-5ddb-49f2-8020-36a63970c193 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG nova.compute.manager [req-b2f26f4d-c9b7-46ec-8bb0-9217d90c0066 req-5b028314-5ddb-49f2-8020-36a63970c193 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing instance network info cache due to event network-changed-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b2f26f4d-c9b7-46ec-8bb0-9217d90c0066 req-5b028314-5ddb-49f2-8020-36a63970c193 service nova] Acquiring lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b2f26f4d-c9b7-46ec-8bb0-9217d90c0066 req-5b028314-5ddb-49f2-8020-36a63970c193 service nova] Acquired lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG nova.network.neutron [req-b2f26f4d-c9b7-46ec-8bb0-9217d90c0066 req-5b028314-5ddb-49f2-8020-36a63970c193 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Refreshing network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:56 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Instance destroyed successfully.
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.objects.instance [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lazy-loading 'resources' on Instance uuid 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3 {{(pid=75288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.vif [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T14:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-191619064',display_name='tempest-TestShelveInstance-server-191619064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-191619064',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaTfWqFnScfDQvc1iGBKh7J9lY1UZczsoJeq95eSWXbM+O9s/k/RlP113Er93a2KBe7P8P/gG5zTmrn6ikETkZvKarDBTU1lO7zmH2LVcr12lslMObr4WQn5C4zKcFJqw==',key_name='tempest-TestShelveInstance-2098869375',keypairs=<?>,launch_index=0,launched_at=2023-12-01T14:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14db84cd86654aad9f8564d909447c62',ramdisk_id='',reservation_id='r-rkq5nofm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-599310837',owner_user_name='tempest-TestShelveInstance-599310837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T14:21:21Z,user_data=None,user_id='67d2e20a449a40a7af858040cd775587',uuid=0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converting VIF {"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.network.os_vif_util [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_vif [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89') {{(pid=75288) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb02f0ed-89, bridge=br-int, if_exists=True) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ff80150-da15-43ff-8bdb-850a61f8393d) {{(pid=75288) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:22:57 user nova-compute[75288]: INFO os_vif [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:4e:b0,bridge_name='br-int',has_traffic_filtering=True,id=eb02f0ed-891c-4dfb-a17c-6b76d882c6f5,network=Network(e47386c4-fb3e-4bac-925f-ceaf21517299),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb02f0ed-89')
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] calling os-brick to detach iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdbbc254670>, {'target_iqn': 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJeCkZUc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 14:22:57 user nova-compute[75288]: WARNING os_brick.initiator.connectors.base [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a37ba9a-4d88-40c9-9919-c50aa04a4bfc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 14:22:57 user nova-compute[75288]: No targets found.
Dec 01 14:22:57 user nova-compute[75288]: iSNS:
Dec 01 14:22:57 user nova-compute[75288]: No targets found.
Dec 01 14:22:57 user nova-compute[75288]: STATIC:
Dec 01 14:22:57 user nova-compute[75288]: Target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b
Dec 01 14:22:57 user nova-compute[75288]:         Portal: 172.16.0.220:3260,-1
Dec 01 14:22:57 user nova-compute[75288]:                 Iface Name: default
Dec 01 14:22:57 user nova-compute[75288]: FIRMWARE:
Dec 01 14:22:57 user nova-compute[75288]: No targets found.
Dec 01 14:22:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 14:22:57 user nova-compute[75288]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 14:22:57 user nova-compute[75288]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75288) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b', 0)] {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[19df5f5f-9b01-4852-9744-cb755313f662]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-b2f26f4d-c9b7-46ec-8bb0-9217d90c0066 req-5b028314-5ddb-49f2-8020-36a63970c193 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updated VIF entry in instance network info cache for port eb02f0ed-891c-4dfb-a17c-6b76d882c6f5. {{(pid=75288) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.network.neutron [req-b2f26f4d-c9b7-46ec-8bb0-9217d90c0066 req-5b028314-5ddb-49f2-8020-36a63970c193 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [{"id": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "address": "fa:16:3e:cd:4e:b0", "network": {"id": "e47386c4-fb3e-4bac-925f-ceaf21517299", "bridge": "br-int", "label": "tempest-TestShelveInstance-2092351898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14db84cd86654aad9f8564d909447c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb02f0ed-89", "ovs_interfaceid": "eb02f0ed-891c-4dfb-a17c-6b76d882c6f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e200d834-714c-42dd-8b14-083442cb5f2e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:22:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b (non-flash)
Dec 01 14:22:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdb98b100d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b'): ({'sdb'}, set())}) {{(pid=75288) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Removing single pathed devices sdb {{(pid=75288) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-b2f26f4d-c9b7-46ec-8bb0-9217d90c0066 req-5b028314-5ddb-49f2-8020-36a63970c193 service nova] Releasing lock "refresh_cache-0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" {{(pid=75288) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d1ce2a-bb1b-4c2b-99ef-77ecf7bc09ed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d16d343-156d-4e87-beb8-799b302e0dc6]: (4, ('ok\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Flushing IO for device /dev/sdb {{(pid=75288) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98559f5-4116-41ac-9a97-4ceb352913a9]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75288) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1162a2-75ab-4044-a285-ba0e025f98f4]: (4, ('1', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.linuxscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] SCSI volumes sdb have been removed. {{(pid=75288) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc6f24642-0eca7aa1ffe6cc43', '/dev/disk/by-id/scsi-23065636137616131', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c6f24642') {{(pid=86480) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f984ed-c3a9-410f-929a-40a745ec1e82]: (4, None) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b')] {{(pid=75288) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[81be9b94-cb94-484e-9f38-7e61c9d43766]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --logout {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e9c81c-2c82-4074-a671-ff6b2785d37a]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260]
Dec 01 14:22:57 user nova-compute[75288]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b, portal: 172.16.0.220,3260] successful.
Dec 01 14:22:57 user nova-compute[75288]:  stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op delete {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bb2c872-8a6f-42b4-b454-e05de63d990b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86480) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f548132-bf85-4d55-a460-e0bac572f5e0]: (4, ('', '')) {{(pid=86480) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75288) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.base [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] <== disconnect_volume: return (310ms) None {{(pid=75288) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Disconnected iSCSI Volume {{(pid=75288) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 14:22:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Deleting instance files /opt/stack/data/nova/instances/0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3_del
Dec 01 14:22:57 user nova-compute[75288]: INFO nova.virt.libvirt.driver [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Deletion of /opt/stack/data/nova/instances/0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3_del complete
Dec 01 14:22:57 user nova-compute[75288]: INFO nova.compute.manager [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Took 1.15 seconds to destroy the instance on the hypervisor.
Dec 01 14:22:57 user nova-compute[75288]: DEBUG oslo.service.loopingcall [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75288) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.compute.manager [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Deallocating network for instance {{(pid=75288) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 14:22:57 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] deallocate_for_instance() {{(pid=75288) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG nova.network.neutron [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Updating instance_info_cache with network_info: [] {{(pid=75288) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 14:22:58 user nova-compute[75288]: INFO nova.compute.manager [-] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Took 0.47 seconds to deallocate network for instance.
Dec 01 14:22:58 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-unplugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] No waiting events found dispatching network-vif-unplugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-unplugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 for instance with task_state deleting. {{(pid=75288) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] Acquiring lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:22:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] No waiting events found dispatching network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 14:22:58 user nova-compute[75288]: WARNING nova.compute.manager [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received unexpected event network-vif-plugged-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 for instance with vm_state active and task_state deleting.
Dec 01 14:22:58 user nova-compute[75288]: DEBUG nova.compute.manager [req-925ab60f-9c37-449a-899e-306339329041 req-d0115b24-1e11-4c62-b12e-be2c6865d828 service nova] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Received event network-vif-deleted-eb02f0ed-891c-4dfb-a17c-6b76d882c6f5 {{(pid=75288) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 14:22:59 user nova-compute[75288]: INFO nova.compute.manager [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Took 0.82 seconds to detach 1 volumes for instance.
Dec 01 14:22:59 user nova-compute[75288]: DEBUG nova.compute.manager [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] [instance: 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3] Deleting volume: 6bb2c872-8a6f-42b4-b454-e05de63d990b {{(pid=75288) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 14:22:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:22:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:22:59 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:22:59 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:22:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:22:59 user nova-compute[75288]: INFO nova.scheduler.client.report [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Deleted allocations for instance 0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3
Dec 01 14:22:59 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-cbf9a010-2fd1-403e-ade5-7544ed529c5b tempest-TestShelveInstance-599310837 tempest-TestShelveInstance-599310837-project-member] Lock "0db7df3b-cb9b-4ae7-b8d6-daa17dbabfb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.928s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:23:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:23:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:23:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:23:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:23:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:37 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:23:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:23:38 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:23:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=25.035282135009766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:23:38 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:23:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:23:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:23:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:23:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:23:40 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 14:23:40 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:41 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:23:44 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:23:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:49 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:23:49 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:23:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:24:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:24:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:24:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:24:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:24:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:24:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:24:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:24:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:24:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:22 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:24:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:24:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:24:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:24:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:24:32 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:37 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:24:38 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Starting heal instance info cache {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Rebuilding the list of instances to heal {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Didn't find any instances for network info cache update. {{(pid=75288) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75288) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 14:24:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:24:39 user nova-compute[75288]: WARNING nova.virt.libvirt.driver [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 14:24:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Hypervisor/Node resource view: name=user free_ram=9157MB free_disk=25.025081634521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75288) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 14:24:39 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75288) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 14:24:40 user nova-compute[75288]: DEBUG nova.compute.provider_tree [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed in ProviderTree for provider: 6546d821-2196-4219-8f98-fc64fd991628 {{(pid=75288) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 14:24:40 user nova-compute[75288]: DEBUG nova.scheduler.client.report [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Inventory has not changed for provider 6546d821-2196-4219-8f98-fc64fd991628 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75288) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 14:24:40 user nova-compute[75288]: DEBUG nova.compute.resource_tracker [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Compute_service record updated for user:user {{(pid=75288) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 14:24:40 user nova-compute[75288]: DEBUG oslo_concurrency.lockutils [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75288) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 14:24:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:42 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:42 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:24:43 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:44 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:44 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:44 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75288) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 14:24:45 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:24:45 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75288) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 14:24:47 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:52 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:24:57 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:25:02 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:25:05 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:25:07 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:25:08 user nova-compute[75288]: DEBUG oslo_service.periodic_task [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75288) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 14:25:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] Cleaning up deleted instances {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 14:25:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] There are 1 instances to clean {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 14:25:08 user nova-compute[75288]: DEBUG nova.compute.manager [None req-ab01103d-084b-4185-a893-e06a45ab3ce3 None None] [instance: 2c66ff7f-d0d9-43ff-98a4-bb702780e080] Instance has had 5 of 5 cleanup attempts {{(pid=75288) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11222}}
Dec 01 14:25:12 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:25:17 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:25:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 14:25:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:25:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75288) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 14:25:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:25:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75288) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 14:25:22 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 14:25:27 user nova-compute[75288]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75288) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}